This test is designed to test the resample step in the calwebb_image3 pipeline. At the end of the calwebb_image3 pipeline, the set of files defined in an association table will be distortion corrected and combined. Resample is the step that applies the distortion correction using the drizzling algorithm (as defined in the DrizzlePac handbook) and combines the listed files. For more information on the pipeline step visit the links below.
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/resample/main.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/resample
The data for this test were created with the MIRI Data Simulator, and the documentation for that code can be found here: http://miri.ster.kuleuven.be/bin/view/Public/MIRISim_Public
A short description and link to the page: https://outerspace.stsci.edu/display/JWSTCC/Vanilla+Image+Combination
Definition of terms or acronymns.
JWST: James Webb Space Telescope
MIRI: Mid-Infrared Instrument
MIRISim: MIRI Data Simulator
This test is performed by creating a set of simulated data with multiple point sources located at specified coordinates. The simulator puts in the expected distortion, so the initial output data comes out of the simulator in distorted coordinates. When this data is then run through calwebb_detector1, calwebb_image2 and calwebbb_image3, the combined, undistorted image should have the point sources registered at the expected locations. In flight, this test can be repeated with known stars that should be found at their expected coordinates. This notebook also checks that flux values for simulated data with roughly equivalent input values show no systematic patterns after resampling. This portion of the test will only work with simulated data created for that purpose.
The set of data used in this particular test were created with the MIRI Data Simulator (MIRISim). Referring to the MIRISim link, you can see how to set up and run the simulator to re-create the input files if you wish. The data was run with a scene.ini file that specified what the scene should look like, with coordinates for the stars given in units of arcsecond offsets from the center of the field of view. The scene.ini file as well as the setup files simuation.ini and simulator.ini are needed to run the simulation.
Once in the mirisim conda environment, the simulation is run with the command line:
mirisim simulation.ini
The simulator created four files, two exposures each at two different dither positions, using the specified filter. Make sure the WCSAXES header keyword in the SCI extension is set to 2 and not 4. If it is set to 4, change it to 2.
The four files were then run individually through the calwebb_detector1 and calwebb_image2 pipelines. When running the calwebb_detector1 pipeline, increase the threshold for a detection in the jump step from 4 sigma to 10 sigma to avoid a current issue where the jump detection step flags a large percentage of pixels as jumps. This can be done on the command line. (commands to be typed start with $)
The pipelines can be run on the command line with the following commands or put into a script while using the pipeline conda environment.
$ strun calwebb_detector1.cfg filename --steps.jump.rejection_threshold 10.0
The output of the calwebb_detector1 pipeline is a set of four *rate.fits files which will then be run through the calwebb_image2 pipeline.
$ strun calwebb_image2.cfg filename
The output of the calwebb_image2 pipeline was then a set of four *cal.fits files. An association table was created that included these four files as input, and then the files and the association table were run through the calwebb_image3 pipeline.
The cal files are stored in artifactory, and this notebook is meant to pull those files for the test of resample. Step through the cells of this notebook to run calwebb_image3 and then check the alignment.
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
from tempfile import TemporaryDirectory
import os
data_dir = TemporaryDirectory()
os.chdir(data_dir.name)
print(data_dir)
<TemporaryDirectory '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m'>
import os
if 'CRDS_CACHE_TYPE' in os.environ:
if os.environ['CRDS_CACHE_TYPE'] == 'local':
os.environ['CRDS_PATH'] = os.path.join(os.environ['HOME'], 'crds', 'cache')
elif os.path.isdir(os.environ['CRDS_CACHE_TYPE']):
os.environ['CRDS_PATH'] = os.environ['CRDS_CACHE_TYPE']
print('CRDS cache location: {}'.format(os.environ['CRDS_PATH']))
CRDS cache location: /grp/crds/cache
The following packages will need to be imported for the scripts to work.
from astropy.io import ascii, fits
from astropy.stats import sigma_clipped_stats
from astropy.table import Column
from astropy.visualization import SqrtStretch
from astropy.visualization.mpl_normalize import ImageNormalize
from ci_watson.artifactory_helpers import get_bigdata
import glob
from itertools import product
from jwst.datamodels import DrizProductModel, ImageModel
from jwst.pipeline import Detector1Pipeline, Image2Pipeline, Image3Pipeline
from jwst import associations
from jwst.associations.lib.rules_level3_base import DMS_Level3_Base
from jwst.associations import asn_from_list
import math
import matplotlib.pyplot as plt
import numpy as np
import os
from photutils import CircularAperture, DAOStarFinder, CircularAnnulus, aperture_photometry
from jwst.regtest.regtestdata import RegtestData
print("Downloading input files")
#This readnoise file is needed for use with simulated data which has higher readnoise than actual data.
readnoise = get_bigdata('jwst_validation_notebooks',
'validation_data',
'jump',
'jump_miri_test',
'jwst_mirisim_readnoise.fits')
filelist = ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits']
for file in filelist:
input_file = get_bigdata('jwst_validation_notebooks',
'validation_data',
'outlier_detection',
'outlier_detection_miri_test',
file)
print("Finished Downloads")
Downloading input files Finished Downloads
# Run the calwebb_detector1 pipeline
# set up pipeline parameters
rej_thresh=10.0 # rejection threshold for jump step
print('There are ', len(filelist), ' images.')
slopelist = []
# loop over list of files
for file in filelist:
# set up pipeline parameters for input
pipe1 = Detector1Pipeline()
pipe1.jump.rejection_threshold = rej_thresh
pipe1.jump.override_readnoise = readnoise
pipe1.ramp_fit.override_readnoise = readnoise
pipe1.refpix.skip = True # needs update to simulator for this to work properly with simulated data
# set up output file name
base, remainder = file.split('.')
outname = base
pipe1.jump.output_file = outname+'.fits'
#pipe1.ramp_fit.output_file = outname+'.fits'
pipe1.output_file = outname+'.fits'
# Run pipeline on each file
rampfile = pipe1.run(file)
slopelist.append(rampfile)
# Close the input files
#file.close()
print('Detector 1 steps completed on all files.')
print(slopelist)
2022-12-04 04:56:30,324 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 04:56:30,326 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 04:56:30,327 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 04:56:30,330 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 04:56:30,332 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 04:56:30,333 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 04:56:30,334 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 04:56:30,335 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 04:56:30,336 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 04:56:30,337 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 04:56:30,338 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 04:56:30,339 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 04:56:30,341 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 04:56:30,342 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 04:56:30,343 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 04:56:30,345 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 04:56:30,346 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 04:56:30,467 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits',).
2022-12-04 04:56:30,477 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
There are 8 images.
2022-12-04 04:56:31,712 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 04:56:32,085 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 04:56:32,087 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 04:56:32,088 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 04:56:32,089 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 04:56:32,090 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 04:56:32,092 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 04:56:32,092 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 04:56:32,093 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 04:56:32,094 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 04:56:32,095 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 04:56:32,097 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 04:56:32,097 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 04:56:32,098 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 04:56:32,098 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 04:56:32,557 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:32,559 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:32,896 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 04:56:32,897 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 04:56:32,900 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 04:56:33,011 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:33,013 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:33,035 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 04:56:33,517 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 04:56:33,632 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:33,633 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 04:56:33,655 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 04:56:37,825 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1071 saturated pixels
2022-12-04 04:56:37,891 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 04:56:37,902 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 04:56:38,106 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:38,108 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:38,130 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 04:56:38,130 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 04:56:38,130 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 04:56:38,534 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 04:56:38,751 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:38,753 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:39,125 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 04:56:39,336 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:39,338 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:39,678 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 04:56:39,876 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:39,878 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:39,901 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 04:56:40,562 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 04:56:40,775 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:40,777 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:56:40,800 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 04:56:42,048 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 04:56:42,259 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:42,261 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 04:56:42,284 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 04:56:42,665 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 04:56:42,866 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:42,868 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 04:56:42,891 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 04:56:44,422 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 04:56:44,424 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 04:56:45,754 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 04:56:45,962 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:45,964 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 04:56:45,965 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 04:56:45,968 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 04:56:46,165 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:56:46,168 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 04:56:46,179 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 04:56:46,193 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:56:46,218 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:56:46,781 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 04:56:46,934 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 04:56:49,410 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2982 pixels with at least one CR from five or more groups.
2022-12-04 04:56:50,017 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 04:56:52,532 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2445 pixels with at least one CR from five or more groups.
2022-12-04 04:56:53,063 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 04:56:55,843 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2541 pixels with at least one CR from five or more groups.
2022-12-04 04:56:56,387 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.60521 sec
2022-12-04 04:56:56,596 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.417236
2022-12-04 04:56:57,130 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits
2022-12-04 04:56:57,132 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 04:56:57,322 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 04:56:57,323 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 04:56:57,348 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:56:57,348 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:56:57,399 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 04:56:57,400 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 04:56:57,724 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 04:56:57,726 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 04:57:31,321 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 04:57:31,323 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 04:57:31,419 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 04:57:31,632 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 04:57:31,634 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:31,682 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 04:57:31,682 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 04:57:31,688 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 04:57:31,896 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 04:57:31,898 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:31,942 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 04:57:31,943 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 04:57:31,947 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 04:57:32,061 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rateints.fits
2022-12-04 04:57:32,062 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 04:57:32,063 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 04:57:32,129 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits
2022-12-04 04:57:32,130 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 04:57:32,138 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 04:57:32,139 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 04:57:32,140 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 04:57:32,141 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 04:57:32,142 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 04:57:32,143 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 04:57:32,144 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 04:57:32,145 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 04:57:32,147 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 04:57:32,148 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 04:57:32,148 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 04:57:32,149 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 04:57:32,150 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 04:57:32,151 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 04:57:32,153 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 04:57:32,154 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 04:57:32,155 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 04:57:32,353 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits',).
2022-12-04 04:57:32,363 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 04:57:32,738 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 04:57:32,745 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 04:57:32,747 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 04:57:32,748 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 04:57:32,748 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 04:57:32,750 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 04:57:32,751 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 04:57:32,752 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 04:57:32,752 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 04:57:32,754 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 04:57:32,755 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 04:57:32,756 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 04:57:32,757 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 04:57:32,757 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 04:57:32,758 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 04:57:33,334 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:33,336 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:33,665 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 04:57:33,666 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 04:57:33,668 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 04:57:33,875 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:33,877 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:33,899 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 04:57:34,388 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 04:57:34,590 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:34,592 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 04:57:34,614 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 04:57:38,428 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1071 saturated pixels
2022-12-04 04:57:38,489 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 04:57:38,498 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 04:57:38,715 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:38,717 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:38,739 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 04:57:38,739 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 04:57:38,740 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 04:57:39,078 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 04:57:39,284 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:39,286 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:39,616 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 04:57:39,817 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:39,819 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:40,159 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 04:57:40,354 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:40,356 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:40,379 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 04:57:41,009 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 04:57:41,205 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:41,207 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:57:41,229 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 04:57:42,583 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 04:57:42,788 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:42,790 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 04:57:42,812 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 04:57:43,190 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 04:57:43,404 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:43,405 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 04:57:43,429 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 04:57:45,033 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 04:57:45,034 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 04:57:46,294 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 04:57:46,508 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:46,510 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 04:57:46,511 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 04:57:46,513 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 04:57:46,703 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:57:46,705 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 04:57:46,716 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 04:57:46,730 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:57:46,754 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:57:47,319 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 04:57:47,470 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 04:57:50,422 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2941 pixels with at least one CR from five or more groups.
2022-12-04 04:57:51,035 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 04:57:53,540 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2686 pixels with at least one CR from five or more groups.
2022-12-04 04:57:54,100 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 04:57:56,605 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2543 pixels with at least one CR from five or more groups.
2022-12-04 04:57:57,158 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.83829 sec
2022-12-04 04:57:57,371 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.654527
2022-12-04 04:57:57,938 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits
2022-12-04 04:57:57,939 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 04:57:58,173 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 04:57:58,174 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 04:57:58,197 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:57:58,197 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:57:58,247 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 04:57:58,248 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 04:57:58,572 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 04:57:58,574 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 04:58:34,361 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 04:58:34,363 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 04:58:34,459 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 04:58:34,649 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 04:58:34,651 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:34,693 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 04:58:34,694 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 04:58:34,698 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 04:58:34,804 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 04:58:34,806 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:34,847 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 04:58:34,848 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 04:58:34,853 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 04:58:34,967 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rateints.fits
2022-12-04 04:58:34,968 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 04:58:34,968 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 04:58:35,036 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits
2022-12-04 04:58:35,037 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 04:58:35,045 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 04:58:35,046 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 04:58:35,047 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 04:58:35,048 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 04:58:35,049 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 04:58:35,050 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 04:58:35,051 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 04:58:35,052 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 04:58:35,053 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 04:58:35,054 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 04:58:35,055 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 04:58:35,057 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 04:58:35,058 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 04:58:35,059 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 04:58:35,060 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 04:58:35,062 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 04:58:35,064 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 04:58:35,176 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits',).
2022-12-04 04:58:35,186 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 04:58:35,555 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 04:58:35,562 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 04:58:35,565 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 04:58:35,567 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 04:58:35,567 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 04:58:35,568 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 04:58:35,571 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 04:58:35,571 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 04:58:35,571 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 04:58:35,573 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 04:58:35,575 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 04:58:35,576 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 04:58:35,577 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 04:58:35,577 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 04:58:35,578 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 04:58:36,073 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:36,075 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:36,396 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 04:58:36,397 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 04:58:36,399 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 04:58:36,510 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:36,512 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:36,533 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 04:58:37,021 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 04:58:37,129 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:37,131 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 04:58:37,153 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 04:58:40,826 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1100 saturated pixels
2022-12-04 04:58:40,885 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 04:58:40,893 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 04:58:41,003 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:41,004 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:41,024 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 04:58:41,025 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 04:58:41,025 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 04:58:41,355 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 04:58:41,464 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:41,466 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:41,787 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 04:58:41,900 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:41,901 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:42,241 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 04:58:42,358 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:42,359 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:42,382 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 04:58:43,000 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 04:58:43,114 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:43,116 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:58:43,138 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 04:58:44,415 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 04:58:44,537 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:44,538 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 04:58:44,561 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 04:58:44,937 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 04:58:45,049 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:45,051 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 04:58:45,072 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 04:58:46,649 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 04:58:46,650 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 04:58:47,919 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 04:58:48,043 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:48,044 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 04:58:48,045 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 04:58:48,047 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 04:58:48,154 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 04:58:48,156 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 04:58:48,166 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 04:58:48,179 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:58:48,203 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:58:48,764 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 04:58:48,916 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 04:58:51,383 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2858 pixels with at least one CR from five or more groups.
2022-12-04 04:58:51,970 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 04:58:54,522 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2639 pixels with at least one CR from five or more groups.
2022-12-04 04:58:55,084 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 04:58:57,584 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2384 pixels with at least one CR from five or more groups.
2022-12-04 04:58:58,106 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.34042 sec
2022-12-04 04:58:58,312 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.146157
2022-12-04 04:58:58,840 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits
2022-12-04 04:58:58,840 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 04:58:58,957 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 04:58:58,958 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 04:58:58,986 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:58:58,986 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:58:59,036 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 04:58:59,036 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 04:58:59,351 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 04:58:59,353 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 04:59:34,094 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 04:59:34,096 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 04:59:34,186 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 04:59:34,324 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 04:59:34,325 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:34,366 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 04:59:34,367 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 04:59:34,372 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 04:59:34,483 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 04:59:34,484 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:34,527 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 04:59:34,528 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 04:59:34,532 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 04:59:34,641 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rateints.fits
2022-12-04 04:59:34,642 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 04:59:34,642 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 04:59:34,707 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits
2022-12-04 04:59:34,708 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 04:59:34,716 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 04:59:34,717 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 04:59:34,718 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 04:59:34,719 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 04:59:34,720 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 04:59:34,721 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 04:59:34,722 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 04:59:34,723 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 04:59:34,724 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 04:59:34,725 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 04:59:34,727 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 04:59:34,728 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 04:59:34,729 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 04:59:34,730 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 04:59:34,731 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 04:59:34,733 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 04:59:34,734 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 04:59:34,843 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits',).
2022-12-04 04:59:34,853 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 04:59:35,232 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 04:59:35,240 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 04:59:35,241 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 04:59:35,242 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 04:59:35,243 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 04:59:35,244 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 04:59:35,245 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 04:59:35,245 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 04:59:35,246 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 04:59:35,247 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 04:59:35,248 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 04:59:35,249 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 04:59:35,249 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 04:59:35,249 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 04:59:35,250 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 04:59:35,713 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:35,714 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:36,046 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 04:59:36,047 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 04:59:36,051 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 04:59:36,164 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:36,165 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:36,188 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 04:59:36,667 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 04:59:36,775 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:36,777 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 04:59:36,799 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 04:59:40,576 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1101 saturated pixels
2022-12-04 04:59:40,635 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 04:59:40,643 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 04:59:40,752 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:40,753 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:40,773 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 04:59:40,774 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 04:59:40,774 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 04:59:41,107 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 04:59:41,216 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:41,217 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:41,553 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 04:59:41,661 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:41,663 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:42,002 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 04:59:42,113 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:42,115 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:42,138 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 04:59:42,769 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 04:59:42,878 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:42,880 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 04:59:42,902 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 04:59:44,292 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 04:59:44,524 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:44,528 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 04:59:44,554 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 04:59:44,975 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 04:59:45,228 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:45,230 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 04:59:45,257 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 04:59:46,910 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 04:59:46,911 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 04:59:48,256 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 04:59:48,400 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:48,401 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 04:59:48,402 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 04:59:48,404 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 04:59:48,508 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 04:59:48,510 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 04:59:48,520 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 04:59:48,535 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:59:48,559 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:59:49,115 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 04:59:49,266 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 04:59:51,697 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2849 pixels with at least one CR from five or more groups.
2022-12-04 04:59:52,273 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 04:59:54,770 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2632 pixels with at least one CR from five or more groups.
2022-12-04 04:59:55,332 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 04:59:57,812 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2479 pixels with at least one CR from five or more groups.
2022-12-04 04:59:58,343 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.22697 sec
2022-12-04 04:59:58,550 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.029964
2022-12-04 04:59:59,072 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits
2022-12-04 04:59:59,073 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 04:59:59,193 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 04:59:59,194 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 04:59:59,216 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 04:59:59,217 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 04:59:59,266 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 04:59:59,266 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 04:59:59,585 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 04:59:59,587 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 05:00:34,819 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 05:00:34,821 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 05:00:34,951 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 05:00:35,111 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:00:35,112 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:35,165 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:00:35,166 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:00:35,170 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:00:35,275 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:00:35,276 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:35,320 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:00:35,320 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:00:35,325 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:00:35,431 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rateints.fits
2022-12-04 05:00:35,431 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 05:00:35,432 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:00:35,495 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits
2022-12-04 05:00:35,496 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 05:00:35,504 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 05:00:35,505 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 05:00:35,506 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 05:00:35,507 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 05:00:35,508 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 05:00:35,509 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 05:00:35,510 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 05:00:35,511 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 05:00:35,512 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 05:00:35,513 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 05:00:35,514 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 05:00:35,516 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 05:00:35,517 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 05:00:35,518 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 05:00:35,519 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 05:00:35,521 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 05:00:35,521 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 05:00:35,629 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits',).
2022-12-04 05:00:35,639 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 05:00:36,002 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 05:00:36,006 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 05:00:36,009 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 05:00:36,011 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 05:00:36,011 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 05:00:36,012 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 05:00:36,014 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 05:00:36,014 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 05:00:36,014 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 05:00:36,016 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 05:00:36,018 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 05:00:36,020 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 05:00:36,020 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 05:00:36,021 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 05:00:36,021 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 05:00:36,490 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:36,491 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:36,821 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 05:00:36,822 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 05:00:36,824 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 05:00:36,938 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:36,940 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:36,961 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 05:00:37,475 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 05:00:37,589 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:37,591 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 05:00:37,612 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 05:00:41,416 - stpipe.Detector1Pipeline.saturation - INFO - Detected 957 saturated pixels
2022-12-04 05:00:41,474 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 05:00:41,482 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 05:00:41,593 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:41,595 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:41,615 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 05:00:41,615 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 05:00:41,616 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 05:00:41,947 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 05:00:42,062 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:42,064 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:42,399 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 05:00:42,512 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:42,513 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:42,856 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 05:00:42,966 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:42,968 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:42,991 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 05:00:44,908 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 05:00:45,023 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:45,025 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:00:45,047 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 05:00:46,549 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 05:00:46,665 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:46,667 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 05:00:46,690 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 05:00:47,086 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 05:00:47,206 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:00:47,208 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 05:00:47,230 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 05:01:07,847 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 05:01:07,847 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 05:01:09,160 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 05:01:09,283 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:01:09,284 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 05:01:09,285 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 05:01:09,288 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 05:01:09,390 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:01:09,392 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 05:01:09,402 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 05:01:09,416 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:01:09,440 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:01:09,995 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 05:01:10,148 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 05:01:12,611 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2601 pixels with at least one CR from five or more groups.
2022-12-04 05:01:13,210 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 05:01:15,726 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2274 pixels with at least one CR from five or more groups.
2022-12-04 05:01:16,283 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 05:01:18,834 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2368 pixels with at least one CR from five or more groups.
2022-12-04 05:01:19,410 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.41333 sec
2022-12-04 05:01:19,618 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.215781
2022-12-04 05:01:20,144 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits
2022-12-04 05:01:20,145 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 05:01:20,264 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 05:01:20,266 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 05:01:20,289 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:01:20,290 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:01:20,341 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 05:01:20,342 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 05:01:20,663 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 05:01:20,665 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 05:01:53,524 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 05:01:53,526 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 05:01:53,648 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 05:01:53,900 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 05:01:53,903 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:01:53,950 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:01:53,951 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:01:53,955 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:01:54,210 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 05:01:54,212 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:01:54,260 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:01:54,260 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:01:54,265 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:01:54,395 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rateints.fits
2022-12-04 05:01:54,395 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 05:01:54,396 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:01:54,469 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits
2022-12-04 05:01:54,470 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 05:01:54,478 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 05:01:54,480 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 05:01:54,481 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 05:01:54,482 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 05:01:54,483 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 05:01:54,484 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 05:01:54,485 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 05:01:54,487 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 05:01:54,488 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 05:01:54,489 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 05:01:54,490 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 05:01:54,491 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 05:01:54,492 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 05:01:54,493 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 05:01:54,495 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 05:01:54,496 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 05:01:54,497 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 05:01:54,749 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits',).
2022-12-04 05:01:54,761 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 05:01:55,190 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 05:01:55,197 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 05:01:55,199 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 05:01:55,200 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 05:01:55,200 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 05:01:55,202 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 05:01:55,203 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 05:01:55,204 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 05:01:55,204 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 05:01:55,206 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 05:01:55,207 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 05:01:55,209 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 05:01:55,209 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 05:01:55,209 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 05:01:55,210 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 05:01:55,860 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:01:55,862 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:01:56,203 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 05:01:56,204 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 05:01:56,207 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 05:01:56,463 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:01:56,465 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:01:56,489 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 05:01:56,992 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 05:01:57,251 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:01:57,252 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 05:01:57,277 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 05:02:01,682 - stpipe.Detector1Pipeline.saturation - INFO - Detected 957 saturated pixels
2022-12-04 05:02:01,749 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 05:02:01,759 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 05:02:02,020 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:02,021 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:02,045 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 05:02:02,045 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 05:02:02,046 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 05:02:02,382 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 05:02:02,644 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:02,646 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:02,997 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 05:02:03,259 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:03,261 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:03,615 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 05:02:03,885 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:03,887 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:03,915 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 05:02:04,573 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 05:02:04,840 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:04,842 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:04,872 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 05:02:06,432 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 05:02:06,699 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:06,701 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 05:02:06,727 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 05:02:07,128 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 05:02:07,268 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:07,270 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 05:02:07,291 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 05:02:08,830 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 05:02:08,831 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 05:02:10,135 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 05:02:10,257 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:10,258 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 05:02:10,259 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 05:02:10,261 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 05:02:10,364 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:02:10,366 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 05:02:10,376 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 05:02:10,389 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:02:10,412 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:02:10,970 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 05:02:11,121 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 05:02:13,589 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2838 pixels with at least one CR from five or more groups.
2022-12-04 05:02:14,164 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 05:02:16,678 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2162 pixels with at least one CR from five or more groups.
2022-12-04 05:02:17,161 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 05:02:19,673 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2259 pixels with at least one CR from five or more groups.
2022-12-04 05:02:20,172 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.20077 sec
2022-12-04 05:02:20,380 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.004130
2022-12-04 05:02:20,892 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits
2022-12-04 05:02:20,893 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 05:02:21,021 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:02:21,022 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 05:02:21,046 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:02:21,046 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:02:21,096 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 05:02:21,096 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 05:02:21,419 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 05:02:21,421 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 05:02:54,875 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 05:02:54,877 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 05:02:54,967 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 05:02:55,111 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:02:55,113 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:55,157 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:02:55,157 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:02:55,162 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:02:55,278 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:02:55,280 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:55,320 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:02:55,321 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:02:55,325 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:02:55,434 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rateints.fits
2022-12-04 05:02:55,435 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 05:02:55,435 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:02:55,502 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits
2022-12-04 05:02:55,502 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 05:02:55,510 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 05:02:55,512 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 05:02:55,513 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 05:02:55,514 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 05:02:55,515 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 05:02:55,515 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 05:02:55,516 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 05:02:55,517 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 05:02:55,518 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 05:02:55,519 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 05:02:55,520 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 05:02:55,521 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 05:02:55,522 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 05:02:55,523 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 05:02:55,525 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 05:02:55,526 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 05:02:55,527 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 05:02:55,641 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits',).
2022-12-04 05:02:55,652 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 05:02:56,018 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 05:02:56,026 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 05:02:56,029 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 05:02:56,030 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 05:02:56,031 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 05:02:56,032 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 05:02:56,034 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 05:02:56,034 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 05:02:56,035 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 05:02:56,036 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 05:02:56,038 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 05:02:56,039 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 05:02:56,040 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 05:02:56,040 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 05:02:56,041 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 05:02:56,515 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:02:56,516 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:56,853 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 05:02:56,854 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 05:02:56,856 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 05:02:56,978 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:02:56,979 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:02:57,001 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 05:02:57,479 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 05:02:57,597 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:02:57,598 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 05:02:57,620 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 05:03:01,349 - stpipe.Detector1Pipeline.saturation - INFO - Detected 971 saturated pixels
2022-12-04 05:03:01,409 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 05:03:01,417 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 05:03:01,545 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:01,546 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:01,567 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 05:03:01,567 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 05:03:01,568 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 05:03:01,905 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 05:03:02,024 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:02,026 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:02,367 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 05:03:02,485 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:02,486 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:02,827 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 05:03:02,947 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:02,949 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:02,972 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 05:03:03,597 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 05:03:03,717 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:03,719 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:03,741 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 05:03:05,048 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 05:03:05,172 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:05,173 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 05:03:05,195 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 05:03:05,569 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 05:03:05,687 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:05,688 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 05:03:05,710 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 05:03:07,102 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 05:03:07,103 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 05:03:08,447 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 05:03:08,575 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:08,576 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 05:03:08,577 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 05:03:08,579 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 05:03:08,697 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-12-04 05:03:08,699 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 05:03:08,709 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 05:03:08,722 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:03:08,746 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:03:09,313 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 05:03:09,466 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 05:03:11,929 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2614 pixels with at least one CR from five or more groups.
2022-12-04 05:03:12,499 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 05:03:15,045 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2258 pixels with at least one CR from five or more groups.
2022-12-04 05:03:15,545 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 05:03:18,075 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2515 pixels with at least one CR from five or more groups.
2022-12-04 05:03:18,613 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.29876 sec
2022-12-04 05:03:18,820 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.111305
2022-12-04 05:03:19,324 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits
2022-12-04 05:03:19,324 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 05:03:19,446 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 05:03:19,447 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 05:03:19,470 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:03:19,470 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:03:19,518 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 05:03:19,519 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 05:03:19,839 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 05:03:19,840 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 05:03:54,727 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 05:03:54,728 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 05:03:54,819 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 05:03:54,967 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 05:03:54,969 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:55,008 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:03:55,009 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:03:55,013 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:03:55,131 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-12-04 05:03:55,133 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:55,179 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:03:55,180 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:03:55,184 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:03:55,291 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rateints.fits
2022-12-04 05:03:55,292 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 05:03:55,293 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:03:55,357 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits
2022-12-04 05:03:55,357 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-12-04 05:03:55,365 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-12-04 05:03:55,367 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-12-04 05:03:55,368 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-12-04 05:03:55,369 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-12-04 05:03:55,370 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-12-04 05:03:55,371 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-12-04 05:03:55,372 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-12-04 05:03:55,373 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-12-04 05:03:55,374 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-12-04 05:03:55,375 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-12-04 05:03:55,376 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-12-04 05:03:55,377 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-12-04 05:03:55,379 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-12-04 05:03:55,380 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-12-04 05:03:55,382 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-12-04 05:03:55,383 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-12-04 05:03:55,384 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-12-04 05:03:55,505 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits',).
2022-12-04 05:03:55,514 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-12-04 05:03:55,888 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-12-04 05:03:55,896 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-12-04 05:03:55,897 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-12-04 05:03:55,898 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-12-04 05:03:55,899 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-12-04 05:03:55,900 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-12-04 05:03:55,901 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-12-04 05:03:55,902 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits'.
2022-12-04 05:03:55,902 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-12-04 05:03:55,904 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-12-04 05:03:55,905 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-12-04 05:03:55,907 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-12-04 05:03:55,907 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-12-04 05:03:55,907 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-12-04 05:03:55,908 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-12-04 05:03:56,407 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:03:56,408 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:56,738 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-12-04 05:03:56,738 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-12-04 05:03:56,741 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-12-04 05:03:56,860 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:03:56,861 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:03:56,883 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-12-04 05:03:57,368 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-12-04 05:03:57,483 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:03:57,484 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-12-04 05:03:57,505 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-12-04 05:04:01,132 - stpipe.Detector1Pipeline.saturation - INFO - Detected 975 saturated pixels
2022-12-04 05:04:01,191 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-12-04 05:04:01,201 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-12-04 05:04:01,343 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:01,345 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:01,377 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-12-04 05:04:01,377 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-12-04 05:04:01,378 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-12-04 05:04:01,717 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-12-04 05:04:01,839 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:01,841 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:02,176 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-12-04 05:04:02,290 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:02,292 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:02,629 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-12-04 05:04:02,749 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:02,751 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:02,773 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-12-04 05:04:03,369 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-12-04 05:04:03,490 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:03,491 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:03,513 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-12-04 05:04:04,754 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-12-04 05:04:04,869 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:04,871 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-12-04 05:04:04,892 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-12-04 05:04:05,264 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-12-04 05:04:05,381 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:05,382 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-12-04 05:04:05,405 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-12-04 05:04:06,776 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-12-04 05:04:06,777 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-12-04 05:04:08,104 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-12-04 05:04:08,233 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:08,234 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-12-04 05:04:08,235 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-12-04 05:04:08,238 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-12-04 05:04:08,350 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-12-04 05:04:08,352 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0, 'min_sat_area': 1.0, 'min_jump_area': 5.0, 'expand_factor': 2.0, 'use_ellipses': False, 'sat_required_snowball': True, 'expand_large_events': False}
2022-12-04 05:04:08,361 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-12-04 05:04:08,375 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:04:08,399 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:04:08,961 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-12-04 05:04:09,114 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-12-04 05:04:11,578 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2560 pixels with at least one CR from five or more groups.
2022-12-04 05:04:12,182 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-12-04 05:04:14,706 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2391 pixels with at least one CR from five or more groups.
2022-12-04 05:04:15,287 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-12-04 05:04:17,833 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2417 pixels with at least one CR from five or more groups.
2022-12-04 05:04:18,458 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.49496 sec
2022-12-04 05:04:18,669 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.307297
2022-12-04 05:04:19,189 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits
2022-12-04 05:04:19,190 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-12-04 05:04:19,344 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:04:19,345 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-12-04 05:04:19,368 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/jwst_mirisim_readnoise.fits
2022-12-04 05:04:19,369 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-12-04 05:04:19,419 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-12-04 05:04:19,420 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-12-04 05:04:19,741 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-12-04 05:04:19,742 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-12-04 05:04:52,989 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-12-04 05:04:52,990 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-12-04 05:04:53,080 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-12-04 05:04:53,225 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:04:53,226 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:53,267 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:04:53,267 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:04:53,272 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:04:53,392 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-12-04 05:04:53,393 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-12-04 05:04:53,436 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-12-04 05:04:53,436 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-12-04 05:04:53,441 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-12-04 05:04:53,551 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rateints.fits
2022-12-04 05:04:53,551 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-12-04 05:04:53,552 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:04:53,619 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits
2022-12-04 05:04:53,620 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
Detector 1 steps completed on all files. [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>]
# Run Calwebb_image2 on output files from detector1
print('There are ', len(slopelist), ' images.')
callist = []
# cycle through files
for rampfile in slopelist:
# create an object for the pipeline
pipe2 = Image2Pipeline()
filename = rampfile.meta.filename
# Set pipeline parameters
pipe2.save_results = True
pipe2.output_file = filename +'_cal.fits'
pipe2.resample.save_results = True
pipe2.suffix = None
calfile = pipe2.run(rampfile)
callist.append(calfile)
print(callist)
2022-12-04 05:04:53,635 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:04:53,636 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:04:53,637 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:04:53,639 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:04:53,640 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:04:53,641 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:04:53,764 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:04:53,768 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:04:53,775 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:04:53,782 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:04:53,783 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:04:53,783 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:04:53,784 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:04:53,784 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:04:53,784 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:04:53,786 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:04:53,788 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:04:53,788 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:04:53,791 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:04:53,794 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:04:53,795 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:04:53,795 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:04:53,795 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:04:53,796 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:04:53,796 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:04:53,796 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:04:53,796 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:04:53,798 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:04:53,798 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:04:53,798 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:04:53,799 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:04:53,799 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:04:53,799 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
There are 8 images.
2022-12-04 05:04:53,833 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:04:53,834 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-12-04 05:04:53,967 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:04:53,969 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:04:54,195 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:04:54,268 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-12-04 05:04:54,269 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-12-04 05:04:54,270 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:04:54,312 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:04:54,319 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:04:54,320 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:04:54,333 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:04:54,459 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:04:54,461 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:04:55,030 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:04:55,031 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:04:55,031 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:04:55,038 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:04:55,162 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:04:55,283 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:04:55,285 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:04:55,315 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:04:55,315 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:04:55,396 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:04:55,396 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:04:55,397 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:04:55,397 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:04:55,482 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:04:55,484 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:04:55,485 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:04:55,485 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:04:55,500 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:04:55,622 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:04:55,624 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:04:55,650 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:04:55,669 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:04:55,670 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:04:55,670 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:04:55,670 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:04:55,671 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:04:55,789 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:04:56,495 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:04:56,712 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:04:57,324 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:04:57,511 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:04:58,072 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:04:58,265 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:04:58,830 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:04:59,029 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:04:59,062 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019529633 -0.016360379 0.022280129 0.014982155 359.990661583 0.017756872 359.987911088 -0.013585662
2022-12-04 05:04:59,195 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_i2d.fits
2022-12-04 05:04:59,196 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:04:59,196 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:04:59,198 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:04:59,198 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:04:59,359 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits
2022-12-04 05:04:59,360 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:04:59,364 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:04:59,365 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:04:59,367 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:04:59,368 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:04:59,369 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:04:59,370 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:04:59,502 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:04:59,507 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:04:59,515 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:04:59,521 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:04:59,522 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:04:59,523 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:04:59,523 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:04:59,524 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:04:59,524 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:04:59,525 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:04:59,526 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:04:59,526 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:04:59,527 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:04:59,528 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:04:59,528 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:04:59,529 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:04:59,529 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:04:59,529 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:04:59,530 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:04:59,530 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:04:59,530 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:04:59,531 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:04:59,531 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:04:59,532 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:04:59,532 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:04:59,532 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:04:59,533 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:04:59,566 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:04:59,567 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-12-04 05:04:59,698 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:04:59,699 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:04:59,884 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:04:59,957 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-12-04 05:04:59,957 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-12-04 05:04:59,958 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:00,003 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:00,011 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:00,012 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:00,025 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:00,152 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:00,153 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:00,262 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:00,263 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:00,263 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:00,270 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:00,402 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:00,537 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:00,538 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:00,563 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:00,564 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:00,648 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:00,648 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:00,649 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:00,649 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:00,695 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:00,697 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:00,698 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:00,698 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:00,713 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:00,841 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:00,842 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:00,869 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:00,887 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:00,888 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:00,888 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:00,888 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:00,889 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:01,006 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:01,602 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:01,790 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:02,383 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:02,582 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:03,186 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:03,372 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:03,928 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:04,118 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:04,150 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019529633 -0.016360379 0.022280129 0.014982155 359.990661583 0.017756872 359.987911088 -0.013585662
2022-12-04 05:05:04,279 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_i2d.fits
2022-12-04 05:05:04,280 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:04,280 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:04,282 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:04,282 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:04,444 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits
2022-12-04 05:05:04,445 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:05:04,450 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:05:04,452 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:05:04,453 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:05:04,455 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:05:04,456 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:05:04,457 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:04,613 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:04,618 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:05:04,625 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:05:04,628 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:05:04,630 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:05:04,631 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:05:04,631 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:05:04,631 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:05:04,632 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:05:04,633 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:04,633 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:05:04,634 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:05:04,635 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:05:04,636 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:05:04,636 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:05:04,636 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:05:04,637 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:05:04,637 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:05:04,637 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:05:04,638 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:05:04,638 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:05:04,639 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:05:04,639 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:05:04,640 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:05:04,640 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:05:04,640 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:05:04,640 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:05:04,676 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:05:04,677 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-12-04 05:05:04,823 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:04,825 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:05:05,015 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:05:05,088 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-12-04 05:05:05,088 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-12-04 05:05:05,089 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:05,134 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:05,141 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:05,141 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:05,154 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:05,289 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:05,291 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:05,402 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:05,403 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:05,404 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:05,410 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:05,543 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:05,680 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:05,681 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:05,706 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:05,706 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:05,793 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:05,793 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:05,794 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:05,794 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:05,841 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:05,843 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:05,844 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:05,844 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:05,859 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:06,001 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:06,003 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:06,033 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:06,053 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:06,054 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:06,054 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:06,055 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:06,055 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:06,176 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:06,793 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:06,972 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:07,606 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:07,813 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:08,387 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:08,582 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:09,150 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:09,354 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:09,387 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020168782 -0.017682172 0.022919277 0.013660362 359.991300731 0.016435079 359.988550236 -0.014907455
2022-12-04 05:05:09,518 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_i2d.fits
2022-12-04 05:05:09,518 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:09,519 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:05:09,520 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:09,521 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:09,685 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits
2022-12-04 05:05:09,685 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:05:09,690 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:05:09,691 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:05:09,693 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:05:09,694 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:05:09,695 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:05:09,696 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:09,868 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:09,873 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:05:09,880 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:05:09,883 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:05:09,886 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:05:09,886 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:05:09,886 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:05:09,887 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:05:09,887 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:05:09,889 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:09,890 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:05:09,890 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:05:09,891 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:05:09,893 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:05:09,893 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:05:09,893 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:05:09,894 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:05:09,894 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:05:09,894 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:05:09,895 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:05:09,895 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:05:09,896 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:05:09,896 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:05:09,897 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:05:09,897 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:05:09,897 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:05:09,898 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:05:09,933 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:09,933 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-12-04 05:05:10,079 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:10,081 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:05:10,266 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:05:10,340 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-12-04 05:05:10,340 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-12-04 05:05:10,341 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:10,385 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:10,393 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:10,393 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:10,407 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:10,546 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:10,547 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:10,652 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:10,653 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:10,653 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:10,660 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:10,789 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:10,929 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:10,931 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:10,955 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:10,955 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:11,041 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:11,042 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:11,042 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:11,043 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:11,088 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:11,090 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:11,091 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:11,091 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:11,106 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:11,249 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:11,250 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:11,277 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:11,295 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:11,296 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:11,296 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:11,297 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:11,297 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:11,416 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:12,040 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:12,221 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:12,792 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:12,982 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:13,609 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:13,803 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:14,371 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:14,565 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:14,597 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020168782 -0.017682172 0.022919277 0.013660362 359.991300731 0.016435079 359.988550236 -0.014907455
2022-12-04 05:05:14,722 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_i2d.fits
2022-12-04 05:05:14,723 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:14,723 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:14,725 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:14,725 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:14,886 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits
2022-12-04 05:05:14,887 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:05:14,891 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:05:14,892 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:05:14,894 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:05:14,895 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:05:14,896 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:05:14,897 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:15,045 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:15,050 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:05:15,057 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:05:15,061 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:05:15,062 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:05:15,063 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:05:15,063 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:05:15,064 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:05:15,064 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:05:15,065 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:15,066 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:05:15,066 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:05:15,067 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:05:15,068 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:05:15,069 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:05:15,069 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:05:15,069 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:05:15,070 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:05:15,070 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:05:15,070 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:05:15,071 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:05:15,072 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:05:15,072 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:05:15,073 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:05:15,073 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:05:15,073 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:05:15,074 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:05:15,107 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:05:15,108 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-12-04 05:05:15,255 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:15,257 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:05:15,445 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:05:15,518 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-12-04 05:05:15,518 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-12-04 05:05:15,519 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:15,563 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:15,571 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:15,571 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:15,584 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:15,730 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:15,731 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:15,841 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:15,842 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:15,842 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:15,849 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:15,985 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:16,129 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:16,131 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:16,156 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:16,156 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:16,263 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:16,264 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:16,264 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:16,265 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:16,310 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:16,312 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:16,313 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:16,314 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:16,328 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:16,475 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:16,477 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:16,504 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:16,523 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:16,524 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:16,524 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:16,525 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:16,525 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:16,644 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:17,254 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:17,430 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:17,993 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:18,191 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:18,764 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:18,954 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:19,520 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:19,714 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:19,747 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020399927 -0.020132946 0.023150422 0.011209589 359.991531876 0.013984305 359.988781381 -0.017358229
2022-12-04 05:05:19,879 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_i2d.fits
2022-12-04 05:05:19,880 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:19,881 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:05:19,882 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:19,883 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:20,046 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits
2022-12-04 05:05:20,047 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:05:20,052 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:05:20,053 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:05:20,054 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:05:20,056 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:05:20,056 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:05:20,058 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:20,231 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:20,235 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:05:20,243 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:05:20,246 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:05:20,248 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:05:20,248 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:05:20,248 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:05:20,249 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:05:20,249 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:05:20,251 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:20,253 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:05:20,253 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:05:20,255 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:05:20,257 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:05:20,257 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:05:20,258 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:05:20,258 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:05:20,258 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:05:20,259 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:05:20,259 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:05:20,260 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:05:20,261 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:05:20,261 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:05:20,262 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:05:20,262 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:05:20,262 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:05:20,263 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:05:20,298 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:20,299 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-12-04 05:05:20,450 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:20,452 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:05:20,642 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:05:20,717 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-12-04 05:05:20,717 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-12-04 05:05:20,718 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:20,763 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:20,770 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:20,771 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:20,784 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:20,931 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:20,933 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:21,093 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:21,093 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:21,094 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:21,101 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:21,230 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:21,376 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:21,378 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:21,402 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:21,402 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:21,485 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:21,486 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:21,486 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:21,486 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:21,531 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:21,533 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:21,533 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:21,534 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:21,548 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:21,687 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:21,689 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:21,716 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:21,735 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:21,735 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:21,736 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:21,736 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:21,736 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:21,854 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:22,472 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:22,655 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:23,213 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:23,405 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:24,012 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:24,249 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:24,827 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:25,031 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:25,062 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020399927 -0.020132946 0.023150422 0.011209589 359.991531876 0.013984305 359.988781381 -0.017358229
2022-12-04 05:05:25,191 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_i2d.fits
2022-12-04 05:05:25,192 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:25,193 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:25,194 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:25,195 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:25,359 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits
2022-12-04 05:05:25,360 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:05:25,365 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:05:25,367 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:05:25,369 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:05:25,370 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:05:25,371 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:05:25,373 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:25,551 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:25,556 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:05:25,564 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:05:25,567 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:05:25,570 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:05:25,570 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:05:25,571 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:05:25,571 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:05:25,571 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:05:25,572 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:25,574 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:05:25,574 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:05:25,575 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:05:25,576 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:05:25,576 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:05:25,577 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:05:25,577 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:05:25,578 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:05:25,578 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:05:25,579 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:05:25,579 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:05:25,580 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:05:25,581 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:05:25,581 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:05:25,581 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:05:25,582 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:05:25,582 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:05:25,617 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:05:25,618 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-12-04 05:05:25,772 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:25,773 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:05:25,960 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:05:26,034 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-12-04 05:05:26,035 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-12-04 05:05:26,035 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:26,079 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:26,087 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:26,087 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:26,101 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:26,243 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:26,244 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:26,347 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:26,348 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:26,349 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:26,355 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:26,481 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:26,630 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:26,631 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:26,656 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:26,657 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:26,741 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:26,742 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:26,742 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:26,743 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:26,789 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:26,791 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:26,792 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:26,793 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:26,808 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:26,953 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-12-04 05:05:26,955 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:26,982 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:27,000 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:27,001 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:27,001 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:27,002 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:27,002 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:27,119 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:27,713 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:27,892 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:28,512 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:28,789 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:29,390 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:29,619 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:30,208 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:30,396 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:30,428 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021935809 -0.019634097 0.024686304 0.011708437 359.993067758 0.014483153 359.990317263 -0.016859381
2022-12-04 05:05:30,555 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_i2d.fits
2022-12-04 05:05:30,556 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:30,556 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-12-04 05:05:30,558 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:30,558 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:30,719 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits
2022-12-04 05:05:30,720 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-12-04 05:05:30,724 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-12-04 05:05:30,726 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-12-04 05:05:30,727 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-12-04 05:05:30,728 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-12-04 05:05:30,730 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-12-04 05:05:30,731 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:30,889 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:30,895 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp8co8gq6m/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-12-04 05:05:30,903 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-12-04 05:05:30,906 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-12-04 05:05:30,908 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-12-04 05:05:30,908 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-12-04 05:05:30,909 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-12-04 05:05:30,909 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-12-04 05:05:30,910 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-12-04 05:05:30,911 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:30,912 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-12-04 05:05:30,913 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-12-04 05:05:30,914 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-12-04 05:05:30,915 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-12-04 05:05:30,916 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-12-04 05:05:30,916 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-12-04 05:05:30,916 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-12-04 05:05:30,917 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-12-04 05:05:30,917 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-12-04 05:05:30,918 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-12-04 05:05:30,918 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-12-04 05:05:30,919 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-12-04 05:05:30,919 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-12-04 05:05:30,920 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-12-04 05:05:30,920 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-12-04 05:05:30,921 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-12-04 05:05:30,921 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-12-04 05:05:30,956 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:30,958 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-12-04 05:05:31,117 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:31,119 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.1, 'sip_degree': None, 'sip_max_inv_pix_error': 0.1, 'sip_inv_degree': None, 'sip_npoints': 12, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-12-04 05:05:31,307 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-12-04 05:05:31,382 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-12-04 05:05:31,383 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-12-04 05:05:31,383 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-12-04 05:05:31,428 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:31,437 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:31,437 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:31,451 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-12-04 05:05:31,605 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:31,607 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-12-04 05:05:31,722 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:31,723 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:31,724 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:31,731 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-12-04 05:05:31,869 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-12-04 05:05:32,023 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:32,025 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-12-04 05:05:32,050 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-12-04 05:05:32,051 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-12-04 05:05:32,140 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-12-04 05:05:32,140 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-12-04 05:05:32,141 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-12-04 05:05:32,142 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-12-04 05:05:32,187 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-12-04 05:05:32,189 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-12-04 05:05:32,190 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-12-04 05:05:32,190 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-12-04 05:05:32,205 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-12-04 05:05:32,358 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-12-04 05:05:32,361 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:05:32,388 - stpipe.Image2Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:05:32,407 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:05:32,408 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:32,409 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:32,409 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:32,410 - stpipe.Image2Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:32,534 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-12-04 05:05:33,168 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:33,352 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:05:33,921 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:34,115 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:05:34,698 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:34,889 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:05:35,449 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-12-04 05:05:35,639 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:05:35,670 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021935809 -0.019634097 0.024686304 0.011708437 359.993067758 0.014483153 359.990317263 -0.016859381
2022-12-04 05:05:35,798 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_i2d.fits
2022-12-04 05:05:35,799 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-12-04 05:05:35,800 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-12-04 05:05:35,801 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-12-04 05:05:35,802 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_1019.pmap
2022-12-04 05:05:35,965 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits
2022-12-04 05:05:35,966 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
[[<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits>]]
# use asn_from_list to create association table
calfiles = glob.glob('starfield*_cal.fits')
asn = asn_from_list.asn_from_list(calfiles, rule=DMS_Level3_Base, product_name='starfield_50star4ptdither_combined.fits')
# use this if you need to add non'science' exposure types
#asn['products'][0]['members'][1]['exptype'] = 'background'
#asn['products'][0]['members'][2]['exptype'] = 'sourcecat'
# dump association table to a .json file for use in image3
with open('starfield_50star4ptdither_asnfile.json', 'w') as fp:
fp.write(asn.dump()[1])
print(asn)
jwnoprogram-a3001_none_00010_asn with 1 products Rule=DMS_Level3_Base No constraints Products: starfield_50star4ptdither_combined.fits with 8 members
Use the association table to process the .cal files that were output from calwebb_image2. That will be the input for calwebb_image3 that uses the resample step to combine each of the individual images.
# Use regtest infrastructure to access all input files associated with the association file
#rtdata = RegtestData(inputs_root="jwst_validation_notebooks", env="validation_data")
#rtdata.get_asn("resample/resample_miri_test/starfield_50star4ptdither_771_asnfile.json")
#rtdata.input #this should be the list of files associated with the asn
# Run Calwebb_image3 on the association table
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 3.318 #3.27 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 50 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom ='shift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
pipe3=Image3Pipeline()
pipe3.tweakreg.kernel_fwhm = fwhm
pipe3.tweakreg.snr_threshold = snr
pipe3.tweakreg.minobj = minobj
pipe3.tweakreg.sigma = sigma
pipe3.tweakreg.fitgeometry = fit_geom
pipe3.tweakreg.use2dhist = use2dhist
#pipe3.tweakreg.skip = True # test to see if this affects the final output
pipe3.source_catalog.save_results = True
pipe3.save_results = True
# run Image3
#im = pipe3.run(rtdata.input)
image = pipe3.run('starfield_50star4ptdither_asnfile.json')
print('Image 3 pipeline finished.')
2022-12-04 05:05:35,992 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2022-12-04 05:05:35,993 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2022-12-04 05:05:35,995 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2022-12-04 05:05:35,996 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2022-12-04 05:05:35,998 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2022-12-04 05:05:35,999 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:05:36,000 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2022-12-04 05:05:36,164 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_asnfile.json',).
2022-12-04 05:05:36,172 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'use_custom_catalogs': False, 'catalog_format': 'ecsv', 'catfile': '', 'kernel_fwhm': 3.318, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2022-12-04 05:05:36,328 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2022-12-04 05:05:36,343 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2022-12-04 05:05:36,345 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2022-12-04 05:05:36,346 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:05:36,347 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2022-12-04 05:05:37,401 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2022-12-04 05:05:37,404 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'use_custom_catalogs': False, 'catalog_format': 'ecsv', 'catfile': '', 'kernel_fwhm': 3.318, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}
2022-12-04 05:05:37,539 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 98 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:05:37,671 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 98 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:05:37,804 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 102 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:05:37,940 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 103 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:05:38,070 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 86 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:05:38,199 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 88 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:05:38,330 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 83 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:05:38,459 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 83 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:05:38,480 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:38,481 - stpipe.Image3Pipeline.tweakreg - INFO - Number of image groups to be aligned: 8.
2022-12-04 05:05:38,481 - stpipe.Image3Pipeline.tweakreg - INFO - Image groups:
2022-12-04 05:05:38,504 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:05:38,504 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:05:38,527 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:05:38,528 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:05:38,551 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:05:38,551 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:05:38,573 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:05:38,574 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:05:38,597 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:05:38,597 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:05:38,619 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:05:38,619 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:05:38,642 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:05:38,643 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:05:38,665 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:05:38,665 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:05:38,665 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:38,666 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:38,666 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() started on 2022-12-04 05:05:38.666255
2022-12-04 05:05:38,666 - stpipe.Image3Pipeline.tweakreg - INFO - Version 0.8.0
2022-12-04 05:05:38,667 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:38,858 - stpipe.Image3Pipeline.tweakreg - INFO - Selected image 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' as reference image
2022-12-04 05:05:38,863 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:05:38,982 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:38,984 - stpipe.Image3Pipeline.tweakreg - INFO - Found 59 matches for 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:05:38,985 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:38,987 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:05:38,987 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: 4.20853e-05 YSH: -9.17984e-05
2022-12-04 05:05:38,988 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:38,988 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.0010652 FIT MAE: 0.000864669
2022-12-04 05:05:38,989 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-12-04 05:05:39,027 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-12-04 05:05:39,152 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:39,154 - stpipe.Image3Pipeline.tweakreg - INFO - Found 55 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal'...
2022-12-04 05:05:39,154 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:39,156 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal:
2022-12-04 05:05:39,156 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0322701 YSH: 0.0518525
2022-12-04 05:05:39,157 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:39,157 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.437425 FIT MAE: 0.338878
2022-12-04 05:05:39,158 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-12-04 05:05:39,196 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:05:39,320 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:39,321 - stpipe.Image3Pipeline.tweakreg - INFO - Found 55 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:05:39,322 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:39,324 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:05:39,325 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0326498 YSH: 0.0518036
2022-12-04 05:05:39,325 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:39,326 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.437465 FIT MAE: 0.338874
2022-12-04 05:05:39,327 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-12-04 05:05:39,363 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-12-04 05:05:39,490 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:39,492 - stpipe.Image3Pipeline.tweakreg - INFO - Found 48 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal'...
2022-12-04 05:05:39,492 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:39,494 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal:
2022-12-04 05:05:39,494 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0249288 YSH: -0.00722079
2022-12-04 05:05:39,495 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:39,495 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.494393 FIT MAE: 0.401721
2022-12-04 05:05:39,495 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 48 objects.
2022-12-04 05:05:39,531 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:05:39,875 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:39,877 - stpipe.Image3Pipeline.tweakreg - INFO - Found 47 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:05:39,878 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:39,879 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:05:39,880 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.025274 YSH: -0.0232561
2022-12-04 05:05:39,880 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:39,880 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.472396 FIT MAE: 0.371671
2022-12-04 05:05:39,881 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 47 objects.
2022-12-04 05:05:39,916 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-12-04 05:05:40,035 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:40,037 - stpipe.Image3Pipeline.tweakreg - INFO - Found 46 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal'...
2022-12-04 05:05:40,038 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:40,039 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal:
2022-12-04 05:05:40,040 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0272563 YSH: 0.0241337
2022-12-04 05:05:40,040 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:40,040 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.392161 FIT MAE: 0.270689
2022-12-04 05:05:40,041 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2022-12-04 05:05:40,076 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:05:40,194 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:05:40,196 - stpipe.Image3Pipeline.tweakreg - INFO - Found 46 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:05:40,196 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:05:40,198 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:05:40,199 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0278693 YSH: 0.0256817
2022-12-04 05:05:40,199 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:40,199 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.412239 FIT MAE: 0.295567
2022-12-04 05:05:40,199 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2022-12-04 05:05:40,234 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:40,235 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() ended on 2022-12-04 05:05:40.234590
2022-12-04 05:05:40,235 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() TOTAL RUN TIME: 0:00:01.568335
2022-12-04 05:05:40,235 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:05:40,390 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:05:40,398 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,398 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:40,498 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,499 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:40,598 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,599 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:40,699 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,699 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:40,797 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,798 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:40,896 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,897 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:40,997 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:05:40,997 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:05:41,009 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2022-12-04 05:05:41,226 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2022-12-04 05:05:41,228 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2022-12-04 05:05:41,450 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:05:41,450 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2022-12-04 05:05:41.450184
2022-12-04 05:05:41,451 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:05:41,451 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'match'
2022-12-04 05:05:41,451 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2022-12-04 05:05:41,452 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2022-12-04 05:05:41,452 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:05:41,453 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2022-12-04 05:05:52,949 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00819783
2022-12-04 05:05:52,950 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00435007
2022-12-04 05:05:52,951 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0227094
2022-12-04 05:05:52,951 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0128405
2022-12-04 05:05:52,951 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0054264
2022-12-04 05:05:52,952 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0154107
2022-12-04 05:05:52,952 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00232743
2022-12-04 05:05:52,952 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0
2022-12-04 05:05:52,953 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:05:52,953 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2022-12-04 05:05:52.953112
2022-12-04 05:05:52,953 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:11.502928
2022-12-04 05:05:52,954 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:05:52,987 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2022-12-04 05:05:53,191 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2022-12-04 05:05:53,193 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}
2022-12-04 05:05:53,199 - stpipe.Image3Pipeline.outlier_detection - INFO - Performing outlier detection on 8 inputs
2022-12-04 05:05:53,200 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter kernel: square
2022-12-04 05:05:53,200 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:05:53,201 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter fillval: INDEF
2022-12-04 05:05:53,201 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter weight_type: ivm
2022-12-04 05:05:53,201 - stpipe.Image3Pipeline.outlier_detection - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:05:53,390 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:05:53,993 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:05:54,273 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:05:54,281 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:05:55,044 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:05:55,335 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:05:55,343 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:05:56,107 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:05:56,397 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:05:56,405 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:05:57,199 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:05:57,484 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:05:57,492 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:05:58,249 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:05:58,525 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:05:58,533 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:05:59,299 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:05:59,580 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:05:59,588 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:06:00,374 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:00,657 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:06:00,665 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:06:01,429 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:01,718 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:06:07,213 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting median...
2022-12-04 05:06:07,307 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:07,921 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:08,222 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:08,970 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:09,296 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:10,072 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:10,405 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:11,176 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:11,505 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:12,274 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:12,600 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:13,367 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:13,698 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:14,457 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:15,017 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:06:15,775 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-12-04 05:06:15,996 - stpipe.Image3Pipeline.outlier_detection - INFO - Flagging outliers
2022-12-04 05:06:16,179 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:16,198 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:16,212 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 638 (0.06%)
2022-12-04 05:06:16,414 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:16,432 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:16,446 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 663 (0.06%)
2022-12-04 05:06:16,642 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:16,660 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:16,676 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 863 (0.08%)
2022-12-04 05:06:16,872 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:16,890 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:16,905 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 848 (0.08%)
2022-12-04 05:06:17,101 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:17,119 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:17,133 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 528 (0.05%)
2022-12-04 05:06:17,332 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:17,349 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:17,362 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 606 (0.06%)
2022-12-04 05:06:17,784 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:17,802 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:17,816 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 462 (0.04%)
2022-12-04 05:06:18,026 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:06:18,045 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:06:18,060 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 454 (0.04%)
2022-12-04 05:06:18,332 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:06:18,606 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:06:18,887 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:06:19,164 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:06:19,441 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:06:19,714 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:06:19,988 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:06:20,263 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:06:20,264 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2022-12-04 05:06:20,473 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2022-12-04 05:06:20,476 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:06:20,497 - stpipe.Image3Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:06:20,520 - stpipe.Image3Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:06:20,521 - stpipe.Image3Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:06:20,521 - stpipe.Image3Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:06:20,522 - stpipe.Image3Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:06:20,522 - stpipe.Image3Pipeline.resample - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:06:20,698 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_combined.fits
2022-12-04 05:06:21,344 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2022-12-04 05:06:21,942 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:22,884 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:23,830 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:24,761 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:25,709 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:26,703 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:27,634 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:28,600 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:28,780 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:06:29,356 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:30,304 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:31,247 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:32,223 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:33,178 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:34,132 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:35,119 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:36,044 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:36,239 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:06:36,806 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:37,743 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:38,690 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:39,675 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:40,591 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:41,526 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:42,490 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:43,442 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:43,630 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:06:44,214 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:45,195 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:46,160 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:47,138 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:48,104 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:49,076 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:50,049 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:50,994 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-12-04 05:06:51,184 - stpipe.Image3Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:06:51,226 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021871916 -0.020269197 0.024945365 0.014753477 359.990658717 0.017762336 359.987585268 -0.017260339
2022-12-04 05:06:51,690 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_combined_i2d.fits
2022-12-04 05:06:51,691 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2022-12-04 05:06:51,927 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1118) from starfield_50star4ptdither_combined_i2d.fits>,).
2022-12-04 05:06:51,929 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2022-12-04 05:06:51,945 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file: /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2022-12-04 05:06:51,955 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file: /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2022-12-04 05:06:51,956 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2022-12-04 05:06:51,956 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2022-12-04 05:06:51,956 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2022-12-04 05:06:51,957 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2022-12-04 05:06:52,029 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2022-12-04 05:06:52,110 - stpipe.Image3Pipeline.source_catalog - INFO - Background could not be estimated in meshes. Using the entire unmasked array for background estimation: bkg_boxsize=(1142, 1118).
2022-12-04 05:06:52,341 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 285 sources
2022-12-04 05:06:52,679 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_combined_cat.ecsv
2022-12-04 05:06:52,827 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_combined_segm.fits
2022-12-04 05:06:52,829 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_combined_segm.fits
2022-12-04 05:06:52,830 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2022-12-04 05:06:52,832 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
The output of the pipeline command in the previous step (given our association table) is an i2d.fits file. This file is in the format of a JWST Data model type of DrizProductModel and should be opened as such. It is this file that we will use for source finding and to determine whether the stars are found in the expected locations. The i2d file and the associated text file containing the input coordinates of the stars can be found in artifactory.
# Read in the combined data file and list of coordinates
im = ImageModel('starfield_50star4ptdither_combined_i2d.fits')
pixarea = im.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea)
coords = get_bigdata('jwst_validation_notebooks',
'validation_data',
'resample',
'resample_miri_test',
'radec_4ptdith_50star_mosaic_coords.txt')
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt( coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# pull out data portion of input file
data = im.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 2.84403609523084e-13 Image mean, median and std 10.161678 10.829916 46.34863
The block of code below will find the sources in the image, create apertures for each source found, and output the table of x, y coordinates along with the peak pixel value. It will also show a scaled version of the image and mark in blue the positions of sources found.
# Run DAOStarFinder to find sources in image
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
sources.pprint_all()
#print(sources['xcentroid','ycentroid','peak'])
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
id xcentroid ycentroid sharpness roundness1 roundness2 npix sky peak flux mag --- ------------------ ------------------ ------------------- ------------- --------------------- ---- --- ----------------- ------------------ ------------------- 1 695.4768873849597 123.09345386140679 0.48122706472371624 -0.17843401 -0.05705847396235437 25 0.0 2739.67822265625 4.01121711730957 -1.5081904247730562 2 772.5497139436839 126.62722936100566 0.4333626131459059 0.15296648 -0.04009332036251727 25 0.0 2677.057373046875 4.179043769836426 -1.5526922995382264 3 973.4985485352782 151.87781319201048 0.4066066427984635 -0.13043086 -0.061746689981988935 25 0.0 2654.71630859375 4.21962833404541 -1.5631854996899626 4 1040.9504131057192 156.51763105193604 0.4872309401759817 0.037374333 0.05112374597978539 25 0.0 2857.69091796875 4.2113037109375 -1.5610414075330612 5 531.5670391216789 183.2162491709291 0.45203022174209256 -0.14403123 -0.02439307096598126 25 0.0 2753.0380859375 4.094959735870361 -1.5306240896762036 6 795.7620600240112 192.6182172262258 0.46235349582475227 0.16743168 0.08347443950251698 25 0.0 2767.837646484375 4.092608451843262 -1.530000491995539 7 460.94604927202033 204.17190011221226 0.40952241832563374 -0.017137332 0.016104688986099187 25 0.0 2849.06396484375 4.571038722991943 -1.6500372509429129 8 516.4969163945225 217.77212688417637 0.4512472719574508 -0.14851701 -0.052562226922077904 25 0.0 2687.934326171875 3.984842300415039 -1.5010278473198313 9 573.6221794709099 231.4100315182614 0.4308801584782885 -0.12234023 0.06134040474576186 25 0.0 2709.18798828125 4.085455417633057 -1.5281011890993184 10 900.309094984966 253.64419081101315 0.4366954518113767 -0.086376734 0.06809401967183798 25 0.0 2710.171142578125 4.141601085662842 -1.542920664545108 11 637.6482832893241 262.5307391763159 0.4358883579952844 0.19806434 0.06332808414914848 25 0.0 2640.3671875 4.034980297088623 -1.5146035459806753 12 944.2048398946808 281.46591784704935 0.44499460343232133 0.12957999 0.0408836312127665 25 0.0 2679.60302734375 4.139435291290283 -1.5423527449493175 13 1030.9747765436073 282.04190933691 0.42623314059408807 0.08142971 0.06939795331858852 25 0.0 2825.080810546875 4.5303544998168945 -1.6403304671129755 14 466.96913724653365 295.8715341375182 0.41508643598904565 0.028083714 0.05469089311679108 25 0.0 2777.38671875 4.4780802726745605 -1.62772968585158 15 478.61115540256316 302.33109251484547 0.42973271510276184 -0.16943383 0.013347137366053273 25 0.0 2677.8603515625 4.195261001586914 -1.5568974623890905 16 552.4590815148299 313.1919448179232 0.4430090893804968 0.0924202 -0.020522883333791438 25 0.0 2691.052978515625 4.142690658569336 -1.5432062625891287 17 794.0674433034542 323.46192876360124 0.4423851084793877 0.16308336 0.1456068704891493 25 0.0 2756.639404296875 4.205136775970459 -1.5594503154853503 18 558.6884806627603 327.97869192482705 0.39852836227679755 -0.003484431 -0.003761498710130047 25 0.0 2698.655517578125 4.456071853637695 -1.6223804629247067 19 936.2473621610417 341.98780122154255 0.4494268190954719 0.027999135 0.05840971854890569 25 0.0 2847.976318359375 4.408660411834717 -1.6107666187225234 20 804.9596434356149 356.5707403384509 0.4084140067614061 0.02062765 0.12065375309896494 25 0.0 2641.110595703125 4.263513565063477 -1.574419122750533 21 443.935719718374 380.0565121241753 0.43846849171191066 0.004864283 0.031022200659039094 25 0.0 2858.578857421875 4.480772972106934 -1.6283823500420551 22 728.6328780321769 405.6017067903938 0.43021574161322734 0.17921092 -0.1864117098389245 25 0.0 4888.927734375 7.693710803985596 -2.21533964436236 23 784.4852062369392 429.2849368872163 0.46726685767065895 0.18001758 0.017060911991662875 25 0.0 2747.728759765625 4.094724655151367 -1.5305617586667197 24 622.5433605057979 469.35512840242006 0.4647816855519927 -0.22607529 -0.019231953092052133 25 0.0 2718.32421875 3.9805209636688232 -1.4998497887522377 25 520.7083458664933 537.9966789192111 0.41412499681880177 -0.018454138 0.00359237678189744 25 0.0 2772.4677734375 4.525998115539551 -1.6392859219859344 26 753.3806399321455 562.4266715925112 0.452446195205066 0.21440639 0.07887419809196484 25 0.0 2676.755126953125 3.9872660636901855 -1.5016880409600786 27 792.7290023215829 572.5789972194619 0.4193441079638208 0.16590807 0.10221928619326233 25 0.0 2630.01220703125 4.10445499420166 -1.5331387448538458 28 486.01615084341427 575.0138066374245 0.4093437439177251 0.04381405 0.06383725022526653 25 0.0 2771.536865234375 4.514009475708008 -1.6364061660099742 29 758.3755458940878 586.9264220934097 0.4111986177545858 -0.09126295 -0.020614693862750427 25 0.0 2721.006591796875 4.388582229614258 -1.6058106005466937 30 398.7252022376796 626.1795169001109 0.42115179388709373 -0.010608349 0.008266441393530749 25 0.0 2753.684326171875 4.400387763977051 -1.6087273709514869 31 944.3508085628226 671.7327461837529 0.46425683445459504 -0.1613553 0.011596209870324095 25 0.0 2805.35205078125 4.170652389526367 -1.5505099857620175 32 977.9991772171035 681.149592090182 0.3919723898428933 -0.07912512 -0.012122398463573113 25 0.0 2771.753173828125 4.693727493286133 -1.6787946797107833 33 1058.4903567526735 696.7262171292342 0.4677683780235676 0.10364849 -0.016975901750322445 25 0.0 2695.183349609375 4.01188325881958 -1.5083707176580172 34 857.4824924508858 705.4193214543063 0.4676280815235846 0.25801313 0.04608157877295311 25 0.0 2689.0 3.8722076416015625 -1.4698965942044662 35 902.7774192685463 739.2833881827175 0.42061156309652104 -0.09639728 0.04777629503441706 25 0.0 2733.49169921875 4.304750442504883 -1.5848699483681663 36 546.9539941551182 815.9811404687127 0.42993493583685716 0.00010692607 0.0025937213871562374 25 0.0 2854.040283203125 4.517554759979248 -1.6372585640191575 37 752.0069651793241 846.8565327976801 0.41300361048326606 -0.024561219 0.02812427548687811 25 0.0 2833.377685546875 4.626048564910889 -1.6630254693582815 38 1042.5524129523935 848.7935281885725 0.45347147664699183 0.016649505 -0.045308815639865295 25 0.0 2774.169189453125 4.184135437011719 -1.5540143346019493 39 849.4878994720676 856.6755092405767 0.45500538805047214 0.10036823 -0.05885631567358064 25 0.0 2687.703369140625 4.0496134757995605 -1.5185339325192304 40 565.6638996843259 907.4396582447206 0.44134257942476063 0.23155753 0.07347975065206847 25 0.0 2646.056396484375 4.056945323944092 -1.5204978867310006 41 907.2832725420959 964.4267603275954 0.4547212445121062 0.16346736 0.056982205100822414 25 0.0 2740.101318359375 4.180441856384277 -1.5530554685810152 42 862.4202240520881 970.7299016306779 0.44253311109178467 0.06400786 -0.0855558126314827 25 0.0 2761.790771484375 4.204267978668213 -1.5592259750673247 43 908.0646563701695 979.5856333752163 0.45362356328462333 -0.025468294 0.03844432201318057 25 0.0 2818.203857421875 4.446091175079346 -1.6199459111052714 44 898.0908473101824 1024.5763199653786 0.4405980104981531 0.13201416 0.14005909502158712 25 0.0 2696.22802734375 4.14641809463501 -1.5441827276544817 45 1065.204616724153 1024.0860229913724 0.4076933383048138 -0.029189145 0.008703365877059327 25 0.0 2833.987060546875 4.625576496124268 -1.6629146688946153 46 885.7802289652379 1035.3565019053842 0.4646835243274934 -0.10924987 0.06343981855265289 25 0.0 2831.0576171875 4.283621311187744 -1.579527676331578 47 844.633490765497 1037.1253556255858 0.4199790925611236 -0.14990568 -0.03384865774120933 25 0.0 2808.513916015625 4.554217338562012 -1.646034380962365 48 983.3376890371602 1053.1813752305072 0.4485008602820098 0.013301602 -0.02737905573037175 25 0.0 2858.863037109375 4.393416881561279 -1.6070060361462928 49 716.705035791758 1093.54361922369 0.4285509855931338 -0.16045043 0.05060286813869858 25 0.0 2605.2177734375 4.114713191986084 -1.5358489223951544 50 546.9564287152346 1106.9809502324074 0.38228237487668865 0.0035719695 0.03474351306532602 25 0.0 2780.930908203125 4.757469177246094 -1.693439958138422
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data, cmap='Greys', origin='lower', vmin=8,vmax=15)#, norm=norm)
apertures.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
Set a specified annulus (inner and outer radii for the annulus).
Run photometry on aperture and annuli.
Subtract background values in annulus from aperture photometry.
Output should be a table of photometry values printed to the screen (full table has columns id, xcenter, ycenter, aperture_sum and the added columns annulus_median, aperture_bkg and aperture_sum_bkgsub). You can choose which columns you wish to see printed.
# set values for inner and outer annuli to collect background counts
inner_annulus = 10.
outer_annulus = 15.
# set up annulus for background
background_aper = CircularAnnulus(positions, r_in=inner_annulus, r_out=outer_annulus)
# perform photometry on apertures for targets and background annuli
phot_table = aperture_photometry(im.data, apertures)
# perform background subtraction with outlier rejection
bkg_median = []
bkg_mask = background_aper.to_mask(method='center')
bmask = bkg_mask[0]
for mask in bkg_mask:
aper_data = bmask.multiply(data)
aper_data = aper_data[mask.data > 0]
# perform sigma-clipped median
_, median_sigclip, _ = sigma_clipped_stats(aper_data)
bkg_median.append(median_sigclip)
bkg_median = np.array(bkg_median)
# do calculations on background regions found in annuli
# Get average background per pixel
phot_table['annulus_median'] = bkg_median
# Get total background in the science aperture (per pixel * area in aperture)
phot_table['aperture_bkg'] = bkg_median * apertures.area
# subtract background in aperture from flux in aperture
phot_table['aperture_sum_bkgsub'] = phot_table['aperture_sum'] - phot_table['aperture_bkg']
# put aperture sum in pixel scale
phot_table['scaled_ap_sum_bkgsub'] = phot_table['aperture_sum_bkgsub'] * pixarea
#print(phot_table['aperture_sum','annulus_median','aperture_bkg','aperture_sum_bkgsub','scaled_ap_sum_bkgsub'])
phot_table_sub = phot_table['aperture_sum','annulus_median','aperture_bkg','aperture_sum_bkgsub','scaled_ap_sum_bkgsub']
phot_table_sub.pprint_all()
aperture_sum annulus_median aperture_bkg aperture_sum_bkgsub scaled_ap_sum_bkgsub ------------------ ------------------ ------------------ ------------------- ---------------------- 36846.980686608986 14.93050765991211 1172.6393294686504 35674.341357140336 1.0145911449329346e-08 37069.371547282 14.539774894714355 1141.9512498520983 35927.4202974299 1.0217888013441974e-08 37146.21669492824 14.903438568115234 1170.5133279704403 35975.7033669578 1.0231619892694566e-08 37299.3444963277 14.715289115905762 1155.7361045494847 36143.608391778216 1.0279372687810554e-08 37763.247353303275 14.600446701049805 1146.716402378685 36616.53095092459 1.0413873570656677e-08 37583.06609537285 14.600446701049805 1146.716402378685 36436.34969299417 1.0362629370532855e-08 38118.595840084534 14.77898120880127 1160.7384698277917 36957.857370256745 1.0510948036340331e-08 37312.37813455113 14.87005615234375 1167.8914791667708 36144.48665538436 1.0279622469150255e-08 38156.35264782475 14.629406929016113 1148.9909333643159 37007.361714460436 1.0525027250518935e-08 37130.692711588315 14.822688579559326 1164.1712386998227 35966.52147288849 1.0229008528878994e-08 37223.516384749535 14.539774894714355 1141.9512498520983 36081.565134897435 1.0261727361607092e-08 36437.58905406709 14.903438568115234 1170.5133279704403 35267.07572609665 1.0030083633825825e-08 37301.496529897544 14.822688579559326 1164.1712386998227 36137.32529119772 1.0277585751326464e-08 37491.42152713229 14.765673637390137 1159.6932956132334 36331.72823151905 1.0332874649255752e-08 36961.413179723175 14.722012519836426 1156.264159459377 35805.149020263794 1.0183113620874937e-08 37233.0710684976 14.947773456573486 1173.9953819673945 36059.0756865302 1.0255331281315268e-08 37787.74089542015 14.888280868530273 1169.3228450289043 36618.41805039125 1.0414410268556524e-08 37137.069867637285 14.672348022460938 1152.3635189569004 35984.70634868038 1.0234180373192938e-08 37625.833914222734 14.903438568115234 1170.5133279704403 36455.320586252295 1.0368024761051344e-08 36853.555008129355 14.72873592376709 1156.7922143692692 35696.762793760085 1.0152288186834696e-08 37327.16583071833 14.77898120880127 1160.7384698277917 36166.42736089054 1.0285862484991696e-08 66779.99994698925 14.5987229347229 1146.5810180879573 65633.41892890129 1.8666381248720232e-08 37490.57145073713 14.956778526306152 1174.7026384903245 36315.86881224681 1.0328364173169785e-08 37318.08615760276 14.5987229347229 1146.5810180879573 36171.505139514804 1.0287306623560794e-08 37128.92534824998 14.72873592376709 1156.7922143692692 35972.13313388071 1.02306045055206e-08 37231.63779838171 14.903438568115234 1170.5133279704403 36061.12447041127 1.0255913962846175e-08 36698.26701338696 14.629406929016113 1148.9909333643159 35549.276080022646 1.0110342433091072e-08 36911.59046360523 14.87005615234375 1167.8914791667708 35743.69898443846 1.0165637008880889e-08 37129.02909713025 14.888280868530273 1169.3228450289043 35959.70625210135 1.0227070255487435e-08 37044.467652646534 14.672348022460938 1152.3635189569004 35892.10413368963 1.0207843968999735e-08 37440.80429091896 14.852836608886719 1166.5390593862014 36274.26523153276 1.0316531964645624e-08 37008.79169514841 14.792540550231934 1161.8034180134441 35846.988277134966 1.0195012856548863e-08 36695.985667090295 14.852836608886719 1166.5390593862014 35529.44660770409 1.0104702859588736e-08 37528.969931666215 14.822688579559326 1164.1712386998227 36364.79869296639 1.0342280007859969e-08 37322.068613158575 14.740135192871094 1157.687510871105 36164.38110228747 1.0285280521658964e-08 37600.11288760824 14.765673637390137 1159.6932956132334 36440.419591995 1.0363786864499087e-08 37283.36118442455 14.765673637390137 1159.6932956132334 36123.66788881132 1.0273701536791062e-08 37282.8255703648 14.572257041931152 1144.502391728826 36138.323178635976 1.0277869554115803e-08 36925.297563699154 14.822688579559326 1164.1712386998227 35761.12632499933 1.0170593407440789e-08 36957.6453626113 14.722012519836426 1156.264159459377 35801.38120315192 1.0182042040088298e-08 37242.214876755934 14.895859718322754 1169.9180864996722 36072.29679025626 1.0259091410936837e-08 37934.51890167325 14.887275695800781 1169.2438989473403 36765.27500272591 1.0456176915884061e-08 36880.19993687115 14.729589462280273 1156.8592511273334 35723.34068574382 1.0159847035248385e-08 37297.07050648542 14.72873592376709 1156.7922143692692 36140.27829211615 1.027842559544659e-08 37808.81778414099 15.025341033935547 1180.0875252473295 36628.730258893665 1.0417343097876766e-08 37459.76697611657 14.746250629425049 1158.16781613489 36301.59915998168 1.0324305832558942e-08 37758.49967929367 14.614926815032959 1147.8536678715004 36610.64601142217 1.0412199872620363e-08 37946.82731674766 14.966246604919434 1175.446259645702 36771.38105710196 1.0457913499788553e-08 36003.818293373 14.614926815032959 1147.8536678715004 34855.964625501496 9.913162152901556e-09 37362.164025613376 14.765673637390137 1159.6932956132334 36202.47073000014 1.0296113349265838e-08
The output of the next block of code should be a table showing the x and y centroid positions as well as the associated RA and Dec values.
# using wcs info from images, put coordinates into RA, Dec
ra, dec = im.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
# add option to print out list of sources with flux values
outtable = 'sourcelist_phot_rate.txt'
sources.add_column(phot_table['aperture_sum'])
sources.add_column(phot_table['aperture_sum_bkgsub'])
sources.add_column(phot_table['scaled_ap_sum_bkgsub'])
xcentroid ycentroid RA Dec ------------------ ------------------ --------------------- ----------------------- 695.4768873849597 123.09345386140679 0.0008744196286825949 -0.014622459880034746 772.5497139436839 126.62722936100566 359.9985202726622 -0.014306661462618709 973.4985485352782 151.87781319201048 359.99242556199556 -0.012991469340025985 1040.9504131057192 156.51763105193604 359.99036944597395 -0.012667643711837574 531.5670391216789 183.2162491709291 0.006062988925558933 -0.01321975197076472 795.7620600240112 192.6182172262258 359.9979860007638 -0.012220389179595842 460.94604927202033 204.17190011221226 0.008285180075728076 -0.012767148706877365 516.4969163945225 217.77212688417637 0.006618156878560576 -0.012200555784181426 573.6221794709099 231.4100315182614 0.004902951754196733 -0.01162857019855531 900.309094984966 253.64419081101315 359.99494400714025 -0.010067488089100001 637.6482832893241 262.5307391763159 0.003023163969010448 -0.010501852604429804 944.2048398946808 281.46591784704935 359.9936726956075 -0.009096119666750876 1030.9747765436073 282.04190933691 359.99101319906885 -0.008844932360097823 466.96913724653365 295.8715341375182 0.008347254985564781 -0.009938708906664451 478.61115540256316 302.33109251484547 0.00800760391823967 -0.00970927617616864 552.4590815148299 313.1919448179232 0.0057720769347741445 -0.009177451309850626 794.0674433034542 323.46192876360124 359.9983901089874 -0.008212255549923227 558.6884806627603 327.97869192482705 0.005620830075757535 -0.008707208570019123 936.2473621610417 341.98780122154255 359.99407961603754 -0.007261459952228881 804.9596434356149 356.5707403384509 359.99814517401813 -0.007167565677593685 443.935719718374 380.0565121241753 0.009280206165698952 -0.007418926746034492 728.6328780321769 405.6017067903938 0.0006179076965442313 -0.005869308951941822 784.4852062369392 429.2849368872163 359.99896877561963 -0.004992680704553806 622.5433605057979 469.35512840242006 0.004043023171865855 -0.004199646359951366 520.7083458664933 537.9966789192111 0.007350817586764152 -0.0023686252796982815 753.3806399321455 562.4266715925112 0.000281008205300254 -0.0009932221636927586 792.7290023215829 572.5789972194619 359.9991016016198 -0.0005759744945086386 486.01615084341427 575.0138066374245 0.008514376110352861 -0.001326756449302307 758.3755458940878 586.9264220934097 0.0001937610727692437 -0.00022842492600235316 398.7252022376796 626.1795169001109 0.011329102864773668 7.460554784815031e-06 944.3508085628226 671.7327461837529 359.9947185391059 0.002872914895855278 977.9991772171035 681.149592090182 359.9937119596805 0.00325226664837558 1058.4903567526735 696.7262171292342 359.9912853900897 0.003946592951752243 857.4824924508858 705.4193214543063 359.99747326319255 0.0036722219588407887 902.7774192685463 739.2833881827175 359.9961753034242 0.004832661466119555 546.9539941551182 815.9811404687127 0.007294056110670084 0.006227193236190696 752.0069651793241 846.8565327976801 0.0010886182403909014 0.007725931272136276 1042.5524129523935 848.7935281885725 359.9921834291972 0.008567275679764074 849.4878994720676 856.6755092405767 359.9981255139278 0.008289407210184849 565.6638996843259 907.4396582447206 0.006966404773145784 0.009082382411625943 907.2832725420959 964.4267603275954 359.99664304405735 0.011749449447124647 862.4202240520881 970.7299016306779 359.9980358605346 0.01182201389964371 908.0646563701695 979.5856333752163 359.9966598775792 0.01221644229242719 898.0908473101824 1024.5763199653786 359.99708683563597 0.013569367165536845 1065.204616724153 1024.0860229913724 359.99196049740675 0.014004081638146777 885.7802289652379 1035.3565019053842 359.9974933883064 0.013866840683593722 844.633490765497 1037.1253556255858 359.9987600304991 0.013810349979044616 983.3376890371602 1053.1813752305072 359.99454948334073 0.014676046032126217 716.705035791758 1093.54361922369 0.0028351580290036558 0.0151962842623869 546.9564287152346 1106.9809502324074 0.008077145440700317 0.0151515360313974
Difference each set of RA and Dec coordinates in both the input list and the found coordinates, taking into account any angles close to 360/0 degrees. If the difference for both the RA and Dec are below a set tolerance, then the positions match. Take the matched positions and convert the differences from degrees to milli arcseconds, and output the RA and Dec positions as well as the differences.
# Compare input RA, Dec to found RA, Dec
print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail')
deltara = []
deltadec = []
for i in np.arange(0,len(RA_sim)):
for j in np.arange(0,len(ra)):
ra_diff = 180 - abs(abs(RA_sim[i] - ra[j])-180)
dec_diff = 180 - abs(abs(Dec_sim[i] - dec[j])-180)
if ra_diff < 1e-5 and dec_diff < 1e-5:
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
deltara.append(ra_diff)
deltadec.append(dec_diff)
if ra_diff < 30 and dec_diff < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {:15.6f} {:15.6f} {:15.5e} {}'.format(ra[j], dec[j], ra_diff, dec_diff,
phot_table['scaled_ap_sum_bkgsub'][j], test))
RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail
359.998760 0.013810 21.490203 26.459925 1.04122e-08 pass
0.000281 -0.000993 21.570461 10.000211 1.02559e-08 pass
0.006618 -0.012201 24.635237 19.599177 1.02796e-08 pass
359.998520 -0.014307 9.818416 15.618735 1.02179e-08 pass
359.998145 -0.007168 17.373535 15.963561 1.01523e-08 pass
0.007351 -0.002369 22.256688 4.948993 1.02306e-08 pass
359.997473 0.003672 24.252507 15.199052 1.03423e-08 pass
0.008514 -0.001327 16.646003 8.076783 1.01656e-08 pass
0.001089 0.007726 26.574335 17.752580 1.02737e-08 pass
359.996643 0.011749 21.441394 19.618010 1.02591e-08 pass
0.006966 0.009082 20.142817 12.176682 1.01820e-08 pass
359.994080 -0.007261 19.382265 12.744172 1.03680e-08 pass
0.004903 -0.011629 14.573685 23.147285 1.05250e-08 pass
0.008077 0.015152 4.123587 5.270287 1.02961e-08 pass
359.993673 -0.009096 19.095813 24.769200 1.00301e-08 pass
0.002835 0.015196 13.831096 33.423345 9.91316e-09 fail
359.998036 0.011822 14.902075 14.450039 1.04562e-08 pass
0.006063 -0.013220 18.039868 15.292905 1.04139e-08 pass
359.999102 -0.000576 19.434169 10.891820 1.01103e-08 pass
359.998969 -0.004993 22.407769 15.549464 1.03284e-08 pass
0.009280 -0.007419 28.057803 14.663714 1.02859e-08 pass
359.991285 0.003947 16.595677 2.134626 1.01047e-08 pass
359.994944 -0.010067 17.974295 16.242879 1.02290e-08 pass
359.997986 -0.012220 14.397250 20.198953 1.03626e-08 pass
0.007294 0.006227 21.398002 7.895650 1.03638e-08 pass
359.992183 0.008567 16.454890 4.592447 1.02779e-08 pass
0.004043 -0.004200 14.316581 12.073104 1.02873e-08 pass
0.005772 -0.009177 24.923035 12.775285 1.02553e-08 pass
359.991960 0.014004 16.209336 32.693897 1.04173e-08 fail
359.990369 -0.012668 16.394494 22.882637 1.02794e-08 pass
359.996175 0.004833 20.507673 2.381278 1.02853e-08 pass
359.998126 0.008289 19.749860 12.265957 1.01706e-08 pass
0.008285 -0.012767 20.951727 21.064655 1.05109e-08 pass
0.008008 -0.009709 19.425894 17.005766 1.01831e-08 pass
359.993712 0.003252 21.745150 11.759934 1.01950e-08 pass
0.000194 -0.000228 22.460138 12.870266 1.02271e-08 pass
359.994719 0.002873 23.259219 6.893625 1.03165e-08 pass
359.992426 -0.012991 23.176816 19.910376 1.02316e-08 pass
0.000874 -0.014622 12.889337 12.744432 1.01459e-08 pass
0.005621 -0.008707 18.611727 20.849148 1.02342e-08 pass
0.008347 -0.009939 20.682052 19.047936 1.03329e-08 pass
359.996660 0.012216 22.040715 12.392253 1.01598e-08 pass
0.003023 -0.010502 13.809712 22.130624 1.02617e-08 pass
359.991013 -0.008845 17.283352 11.043504 1.02776e-08 pass
359.998390 -0.008212 17.607645 20.680020 1.04144e-08 pass
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in millarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltadec,deltara)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
The output RA and Dec coordinates should match the input RA and Dec coordinates to within 1/10 of a PSF FWHM (~0.03 arcsec for F770W).
Output RA_Diff and Dec_diff above should be on order of 30 or fewer milliarcseconds.
Check to see if your surface brightness is roughly what you expected based on the input data.
Another test that can be done is to plot the flux values against x and y values to check for any systmatic patterns. Previous testing has shown a spatial dependence of the flux with y values, such that there is a rise in surface brightness in the middle, and a drop at the image edges. A quick plot can show whether this problem is fixed or not. Prior to the resample step, there is no pattern, after the step, a pattern is clear. Just do this as a last check. If the scatter is not random, there may be a problem that needs to be checked. (Of course, this only works if you give an equivalent if not equal input count level to each input star.) If there is not an obvious rise in the middle (around y centroid pos of 550-600), then this test passes.
plt.title('Flux (MJy) vs. y position on detector')
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('y centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['ycentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='')
plt.show()
plt.title('Flux (MJy) vs. x position on detector')
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('x centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['xcentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='') #ylim=(30000,40000))
plt.show()
Check previous tests with different scaling factor to see if the RA/Dec values still line up and the photometry gives consistent results.
# Grab all *.cal files and create a new association table.
callist = glob.glob('starfield*cal.fits')
# use asn_from_list to create association table
asn = asn_from_list.asn_from_list(callist, rule=DMS_Level3_Base, product_name='starfield_50star4ptdither_scaled_combined.fits')
# use this if you need to add non'science' exposure types
#asn['products'][0]['members'][1]['exptype'] = 'background'
#asn['products'][0]['members'][2]['exptype'] = 'sourcecat'
# dump association table to a .json file for use in image3
with open('starfield_50star4ptdither_scaled_asnfile.json', 'w') as fp:
fp.write(asn.dump()[1])
# Run Calwebb_image3 on the association table
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 5.0 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 50 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom = 'shift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
ratio = 0.5 # Ratio of input to output pixel scale. A value of 0.5 means the output image would have 4 pixels
# sampling each input pixel.
pipe3=Image3Pipeline()
pipe3.tweakreg.kernel_fwhm = fwhm
pipe3.tweakreg.snr_threshold = snr
pipe3.tweakreg.minobj = minobj
pipe3.tweakreg.sigma = sigma
pipe3.tweakreg.fitgeometry = fit_geom
#pipe3.tweakreg.skip = True
pipe3.tweakreg.use2dhist = use2dhist
pipe3.resample.pixel_scale_ratio = ratio
pipe3.source_catalog.save_results = True
pipe3.save_results = True
# run Image3
image = pipe3.run('starfield_50star4ptdither_scaled_asnfile.json')
print('Image 3 pipeline finished.')
2022-12-04 05:06:55,102 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2022-12-04 05:06:55,103 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2022-12-04 05:06:55,105 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2022-12-04 05:06:55,106 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2022-12-04 05:06:55,108 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2022-12-04 05:06:55,109 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2022-12-04 05:06:55,110 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2022-12-04 05:06:55,346 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_scaled_asnfile.json',).
2022-12-04 05:06:55,353 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'use_custom_catalogs': False, 'catalog_format': 'ecsv', 'catfile': '', 'kernel_fwhm': 5.0, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 0.5, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2022-12-04 05:06:55,482 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2022-12-04 05:06:55,485 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2022-12-04 05:06:55,486 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2022-12-04 05:06:55,487 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-12-04 05:06:55,489 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2022-12-04 05:06:56,600 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2022-12-04 05:06:56,602 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'use_custom_catalogs': False, 'catalog_format': 'ecsv', 'catfile': '', 'kernel_fwhm': 5.0, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}
2022-12-04 05:06:56,793 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:06:56,987 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:06:57,182 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:06:57,380 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:06:57,581 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:06:57,784 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:06:57,992 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits.
2022-12-04 05:06:58,189 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits.
2022-12-04 05:06:58,211 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:58,211 - stpipe.Image3Pipeline.tweakreg - INFO - Number of image groups to be aligned: 8.
2022-12-04 05:06:58,212 - stpipe.Image3Pipeline.tweakreg - INFO - Image groups:
2022-12-04 05:06:58,235 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:06:58,235 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:06:58,259 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:06:58,259 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:06:58,282 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:06:58,282 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:06:58,305 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:06:58,306 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:06:58,328 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:06:58,329 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:06:58,352 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:06:58,352 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:06:58,374 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal':
2022-12-04 05:06:58,374 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal
2022-12-04 05:06:58,397 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal':
2022-12-04 05:06:58,398 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal
2022-12-04 05:06:58,398 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:58,399 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:58,399 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() started on 2022-12-04 05:06:58.398996
2022-12-04 05:06:58,399 - stpipe.Image3Pipeline.tweakreg - INFO - Version 0.8.0
2022-12-04 05:06:58,399 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:58,628 - stpipe.Image3Pipeline.tweakreg - INFO - Selected image 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' as reference image
2022-12-04 05:06:58,633 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:06:58,752 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:58,753 - stpipe.Image3Pipeline.tweakreg - INFO - Found 73 matches for 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:06:58,754 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:58,756 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:06:58,757 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -1.04064e-05 YSH: -9.45202e-06
2022-12-04 05:06:58,757 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:58,758 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.001818 FIT MAE: 0.00145054
2022-12-04 05:06:58,758 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 72 objects.
2022-12-04 05:06:58,794 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-12-04 05:06:58,915 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:58,916 - stpipe.Image3Pipeline.tweakreg - INFO - Found 53 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal'...
2022-12-04 05:06:58,917 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:58,919 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal:
2022-12-04 05:06:58,920 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0416528 YSH: -0.0266671
2022-12-04 05:06:58,920 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:58,920 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.316475 FIT MAE: 0.218744
2022-12-04 05:06:58,921 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 53 objects.
2022-12-04 05:06:58,957 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:06:59,080 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:59,082 - stpipe.Image3Pipeline.tweakreg - INFO - Found 55 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:06:59,083 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:59,084 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:06:59,085 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.050707 YSH: -0.00657054
2022-12-04 05:06:59,085 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:59,085 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.317766 FIT MAE: 0.222451
2022-12-04 05:06:59,086 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-12-04 05:06:59,121 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-12-04 05:06:59,246 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:59,247 - stpipe.Image3Pipeline.tweakreg - INFO - Found 60 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal'...
2022-12-04 05:06:59,248 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:59,250 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal:
2022-12-04 05:06:59,250 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0119643 YSH: 0.0134823
2022-12-04 05:06:59,251 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:59,251 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.334214 FIT MAE: 0.223583
2022-12-04 05:06:59,251 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 60 objects.
2022-12-04 05:06:59,287 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:06:59,410 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:59,411 - stpipe.Image3Pipeline.tweakreg - INFO - Found 60 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:06:59,412 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:59,414 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:06:59,414 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.00110832 YSH: 0.0130964
2022-12-04 05:06:59,415 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:59,415 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.315695 FIT MAE: 0.201238
2022-12-04 05:06:59,415 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 60 objects.
2022-12-04 05:06:59,450 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-12-04 05:06:59,819 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:59,820 - stpipe.Image3Pipeline.tweakreg - INFO - Found 54 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal'...
2022-12-04 05:06:59,821 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:59,823 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal:
2022-12-04 05:06:59,824 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: 0.0142013 YSH: -0.00953756
2022-12-04 05:06:59,824 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:59,824 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.320146 FIT MAE: 0.220856
2022-12-04 05:06:59,825 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 54 objects.
2022-12-04 05:06:59,861 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-12-04 05:06:59,985 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-12-04 05:06:59,986 - stpipe.Image3Pipeline.tweakreg - INFO - Found 53 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal'...
2022-12-04 05:06:59,987 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-12-04 05:06:59,989 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal:
2022-12-04 05:06:59,990 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: 0.00190551 YSH: -0.0279355
2022-12-04 05:06:59,990 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:06:59,990 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.30067 FIT MAE: 0.204943
2022-12-04 05:06:59,991 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 53 objects.
2022-12-04 05:07:00,030 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:07:00,031 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() ended on 2022-12-04 05:07:00.030221
2022-12-04 05:07:00,031 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() TOTAL RUN TIME: 0:00:01.631225
2022-12-04 05:07:00,031 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-12-04 05:07:00,186 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-12-04 05:07:00,194 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,195 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,294 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,295 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,394 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,395 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,493 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,494 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,594 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,594 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,695 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,696 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,797 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-12-04 05:07:00,798 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-12-04 05:07:00,810 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2022-12-04 05:07:01,050 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2022-12-04 05:07:01,052 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2022-12-04 05:07:01,280 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:07:01,281 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2022-12-04 05:07:01.280690
2022-12-04 05:07:01,282 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:07:01,282 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'match'
2022-12-04 05:07:01,283 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2022-12-04 05:07:01,283 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2022-12-04 05:07:01,283 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:07:01,284 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2022-12-04 05:07:12,971 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0104564
2022-12-04 05:07:12,975 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00699186
2022-12-04 05:07:12,975 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0247774
2022-12-04 05:07:12,976 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0148887
2022-12-04 05:07:12,976 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0142996
2022-12-04 05:07:12,976 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0177906
2022-12-04 05:07:12,977 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00264731
2022-12-04 05:07:12,977 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0
2022-12-04 05:07:12,977 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:07:12,978 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2022-12-04 05:07:12.977828
2022-12-04 05:07:12,978 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:11.697138
2022-12-04 05:07:12,978 - stpipe.Image3Pipeline.skymatch - INFO -
2022-12-04 05:07:13,013 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2022-12-04 05:07:13,252 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2022-12-04 05:07:13,257 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}
2022-12-04 05:07:13,266 - stpipe.Image3Pipeline.outlier_detection - INFO - Performing outlier detection on 8 inputs
2022-12-04 05:07:13,267 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter kernel: square
2022-12-04 05:07:13,267 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:07:13,268 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter fillval: INDEF
2022-12-04 05:07:13,268 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter weight_type: ivm
2022-12-04 05:07:13,269 - stpipe.Image3Pipeline.outlier_detection - INFO - Output pixel scale ratio: 1.0
2022-12-04 05:07:13,532 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:14,229 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:14,547 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:07:14,557 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:15,395 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:15,705 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:07:15,714 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:16,590 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:16,897 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:07:16,907 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:17,844 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:18,138 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:07:18,146 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:18,949 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:19,236 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:07:19,245 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:20,028 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:20,352 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:07:20,361 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:21,264 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:21,565 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-12-04 05:07:21,575 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-12-04 05:07:22,409 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-12-04 05:07:22,721 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-12-04 05:07:28,710 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting median...
2022-12-04 05:07:28,806 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:29,432 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:29,726 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:30,459 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:30,786 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:31,530 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:31,857 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:32,596 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:32,916 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:33,665 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:33,993 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:34,749 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:35,077 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:35,869 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:36,435 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-12-04 05:07:37,222 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-12-04 05:07:37,451 - stpipe.Image3Pipeline.outlier_detection - INFO - Flagging outliers
2022-12-04 05:07:37,637 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:37,655 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:37,670 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 564 (0.05%)
2022-12-04 05:07:37,880 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:37,898 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:37,913 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 571 (0.05%)
2022-12-04 05:07:38,132 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:38,150 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:38,166 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 805 (0.08%)
2022-12-04 05:07:38,377 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:38,396 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:38,411 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 933 (0.09%)
2022-12-04 05:07:38,615 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:38,633 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:38,649 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 439 (0.04%)
2022-12-04 05:07:38,854 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:38,872 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:38,887 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 404 (0.04%)
2022-12-04 05:07:39,085 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:39,103 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:39,117 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 528 (0.05%)
2022-12-04 05:07:39,577 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-12-04 05:07:39,594 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-12-04 05:07:39,607 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 494 (0.05%)
2022-12-04 05:07:39,868 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:07:40,139 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:07:40,417 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:07:40,693 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:07:40,970 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:07:41,247 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:07:41,529 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-12-04 05:07:41,803 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-12-04 05:07:41,803 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2022-12-04 05:07:42,022 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2022-12-04 05:07:42,024 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 0.5, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-12-04 05:07:42,047 - stpipe.Image3Pipeline.resample - INFO - Using drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-12-04 05:07:42,073 - stpipe.Image3Pipeline.resample - INFO - Driz parameter kernel: square
2022-12-04 05:07:42,074 - stpipe.Image3Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-12-04 05:07:42,074 - stpipe.Image3Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-12-04 05:07:42,074 - stpipe.Image3Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-12-04 05:07:42,075 - stpipe.Image3Pipeline.resample - INFO - Output pixel scale ratio: 0.5
2022-12-04 05:07:42,259 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_scaled_combined.fits
2022-12-04 05:07:42,984 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2022-12-04 05:07:43,686 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:44,771 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:45,845 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:46,918 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:48,004 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:49,095 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:50,162 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:51,209 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:51,534 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2022-12-04 05:07:52,137 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:53,288 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:54,436 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:55,585 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:56,721 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:57,860 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:07:59,004 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:00,161 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:00,536 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2022-12-04 05:08:01,144 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:02,297 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:03,461 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:04,606 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:05,724 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:06,914 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:08,076 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:09,252 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:09,657 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2022-12-04 05:08:10,268 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:11,424 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:12,567 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:13,728 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:14,880 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:16,042 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:17,181 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:18,367 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (2284, 2237)
2022-12-04 05:08:18,730 - stpipe.Image3Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:302: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-12-04 05:08:18,843 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021885075 -0.020259823 0.024958525 0.014762852 359.990656543 0.017773056 359.987583093 -0.017249618
2022-12-04 05:08:19,385 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_scaled_combined_i2d.fits
2022-12-04 05:08:19,385 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2022-12-04 05:08:19,623 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(2284, 2237) from starfield_50star4ptdither_scaled_combined_i2d.fits>,).
2022-12-04 05:08:19,625 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2022-12-04 05:08:19,642 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file: /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2022-12-04 05:08:19,652 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file: /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2022-12-04 05:08:19,652 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2022-12-04 05:08:19,653 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2022-12-04 05:08:19,653 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2022-12-04 05:08:19,653 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2022-12-04 05:08:19,704 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2022-12-04 05:08:20,755 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 705 sources
2022-12-04 05:08:21,634 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_scaled_combined_cat.ecsv
2022-12-04 05:08:21,795 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_scaled_combined_segm.fits
2022-12-04 05:08:21,797 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_scaled_combined_segm.fits
2022-12-04 05:08:21,799 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2022-12-04 05:08:21,801 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
# Read in the combined data file and list of coordinates
im2 = ImageModel('starfield_50star4ptdither_scaled_combined_i2d.fits')
#get pixel scale
pixarea2 = im2.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea2)
print('Ratio of pixel area scales: original/new scale', pixarea / pixarea2)
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt( coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# pull out data portion of input file
data2 = im2.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data2, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 7.1100902380771e-14 Ratio of pixel area scales: original/new scale 4.0 Image mean, median and std 10.193526 10.818869 48.573162
# Run DAOStarFinder to find sources in image
pixel_ratio = math.sqrt(pixarea / pixarea2) # ratio of pixel area scales in single dimension (sqrt of area)
ap_radius2 = ap_radius * pixel_ratio # radius for aperture for centroiding and photometry
print('New aperture radius', ap_radius2)
daofind = DAOStarFinder(fwhm=3.0*pixel_ratio, threshold=10.*std) # default threshold=5*std, fwhm=3
sources2 = daofind(data2)
#print(sources2['xcentroid','ycentroid','peak'])
sources2.pprint_all()
# Create apertures for x,y positions
positions2 = tuple(zip(sources2['xcentroid'], sources2['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures2 = CircularAperture(positions2, r=ap_radius2)
New aperture radius 10.0 id xcentroid ycentroid sharpness roundness1 roundness2 npix sky peak flux mag --- ------------------ ------------------ ------------------- ------------- --------------------- ---- --- ----------------- ------------------ ------------------- 1 1391.6141252999453 245.0347408093039 0.3297904722630038 -0.03636884 -0.029321784964952226 49 0.0 2828.673583984375 6.97028923034668 -2.1081269985224353 2 1545.7572347543412 252.1019559115091 0.33051244369240573 -0.019204263 -0.02095666706152514 49 0.0 2842.495849609375 6.922647476196289 -2.1006805412051115 3 1947.5277150205711 302.60840183885466 0.3712583382295071 0.0456527 0.2260919438518633 49 0.0 2829.14404296875 6.184299468994141 -1.9782262793223413 4 2082.6746723236847 311.9378235763498 0.356422392334879 -0.067164466 -0.17237013741548138 49 0.0 2970.14453125 7.725893974304199 -2.219871859609183 5 1063.789366061669 365.36791486522367 0.35193815511412996 -0.036166113 0.0005707872675012988 49 0.0 2872.04052734375 6.789588928222656 -2.0796087024137573 6 1592.116892800431 384.2801435010961 0.36680254382044175 0.023494948 0.020647401167496925 49 0.0 2883.150634765625 6.7344207763671875 -2.070750620620711 7 922.4767877401614 407.3003916342195 0.4177383879109734 0.090439714 0.06293319057456509 49 0.0 2940.064697265625 6.59037446975708 -2.047275230539908 8 1033.4790422750223 434.48916184739574 0.39984447241371784 -0.012154977 0.06418114326231195 49 0.0 2947.487060546875 6.749234676361084 -2.073136322937831 9 1147.8735992775044 461.6758020522051 0.35348334123748254 0.032225892 -0.008926326725951646 49 0.0 2890.42578125 6.922603130340576 -2.100673586054577 10 1801.1754815096374 506.36616454715164 0.3809522257646451 0.042001028 0.1294181538655776 49 0.0 2915.351806640625 6.633906841278076 -2.0544234212737984 11 1275.8977202015315 524.0219496370104 0.33776249766688665 0.0057967436 -0.011219702306756238 49 0.0 2871.284912109375 6.9150071144104 -2.099481578158728 12 1888.9736670250409 561.8540753047181 0.3563405808472645 0.042324267 0.20006022646021335 49 0.0 2872.70166015625 6.519236087799072 -2.035491772193893 13 2062.7020619770788 563.1897196580086 0.36253077006843104 -0.021323888 -0.030664649542741437 49 0.0 2942.35595703125 7.016805171966553 -2.115348545278676 14 934.5238670790632 590.5916391162401 0.3325440844368735 0.08507051 0.038385319448326 49 0.0 2750.336669921875 6.571325302124023 -2.0441324168046715 15 957.8663043621808 603.6154878016796 0.35319107262483795 0.06374037 0.2747180364140151 49 0.0 2830.77734375 6.406270503997803 -2.0165131818674658 16 1105.436365232163 625.2737905484375 0.3540433460063355 0.0068372125 0.06691069817485319 49 0.0 2847.833251953125 6.720760822296143 -2.068546100127719 17 1588.7189797130275 645.7124120863735 0.34143265865899897 -0.077543095 -0.10670716105596048 49 0.0 2831.036376953125 7.084007263183594 -2.125697494493476 18 1118.021489171493 654.9406193361164 0.35550239706234643 0.002162933 0.0863217037322938 49 0.0 2751.490966796875 6.724700450897217 -2.0691823590765175 19 1873.1081683300906 683.053335092837 0.3503255389233902 -0.031219212 -0.110050977869192 49 0.0 2954.82470703125 7.476707935333252 -2.1842760400376804 20 1610.5291139366375 712.2055396173664 0.37530795272530165 -0.084702656 -0.05433074612954891 49 0.0 2828.248779296875 6.796332836151123 -2.0806865984487675 21 888.4197174580918 758.8545092806571 0.3483241356629812 0.07582415 -0.000978291996502098 49 0.0 2770.1328125 6.740124702453613 -2.0716698292783895 22 1457.9309137897321 810.1849041107366 0.34690173358622095 -0.020288393 -0.2771138993580878 49 0.0 5280.18896484375 12.783531188964844 -2.7666270884004374 23 1569.5317053282063 857.5056076567881 0.3634683748020559 -0.06186067 -0.04670604345490544 49 0.0 2923.72216796875 7.335660457611084 -2.1635980528386067 24 1245.76098431969 937.552373773233 0.34665002330577016 0.013865131 0.13262932825247561 49 0.0 2805.296630859375 6.49240779876709 -2.0310144768965905 25 1041.985541281527 1074.872228360456 0.36104526153746425 -0.006380948 0.001744834390580673 49 0.0 2829.8427734375 6.723819255828857 -2.069040076444465 26 1507.2976762781464 1123.6920818301298 0.3431573817036482 0.044274464 0.0027576700310502117 49 0.0 2793.563720703125 6.825770378112793 -2.0853791858322714 27 1586.083698151982 1144.0416184196597 0.3652488848321837 0.019588696 0.21941609649593113 49 0.0 2785.575927734375 6.404435157775879 -2.016202082399934 28 972.6632177664333 1149.031801792307 0.4089328235407995 0.032709163 0.07841229033765756 49 0.0 2954.919189453125 6.586766719818115 -2.046680706315272 29 1517.3246123518506 1172.7606095131 0.37151420433013543 0.038685627 0.22188072392277453 49 0.0 2848.423095703125 6.174485206604004 -1.9765018861041495 30 797.5450897726604 1250.8549988746404 0.3758987881065301 -0.041664295 -0.067020854776205 49 0.0 2957.57958984375 7.076893329620361 -2.124606623778442 31 1889.2396788869835 1342.5814657915778 0.36480104478558556 -0.062670775 -0.053683338109751975 49 0.0 2918.0205078125 7.201393127441406 -2.143541299770731 32 1956.5852677506557 1361.2698888498435 0.3602904378628903 0.024423333 0.035420695840671854 49 0.0 2814.830078125 6.616738796234131 -2.051609976705249 33 2117.779364809172 1392.7052968385651 0.34091276750602467 -0.017091287 -0.08540002590256382 49 0.0 2867.962158203125 6.997644901275635 -2.112379750579646 34 1715.5379910822505 1409.6123166210257 0.38536333805619705 0.018137662 -0.14577147364297868 49 0.0 2923.70849609375 6.94224739074707 -2.1037502148257903 35 1806.178817220617 1477.5269226225776 0.3321160846701551 -0.0033967418 0.021254240009048624 49 0.0 2786.41796875 6.651130199432373 -2.0572386236605436 36 1094.5143440249483 1630.8864524711996 0.34681386239660084 0.0022618072 -0.003207221679064814 49 0.0 2860.345703125 6.8972978591918945 -2.096697453405808 37 1504.5800979038495 1692.5731444071218 0.39744108591700594 0.035629414 0.04936532041263552 49 0.0 2974.385009765625 6.736386299133301 -2.0710674597279195 38 2085.9213614890537 1696.8312045615687 0.35163406627922417 -0.038298197 -0.05625746292479098 49 0.0 2951.78125 7.46921968460083 -2.1831880827268275 39 1699.6587221957616 1712.450589623288 0.3909586514340723 -0.12314629 -0.04976866558487966 49 0.0 2899.830322265625 6.794972896575928 -2.080469321953479 40 1131.9528079734248 1813.9665719297636 0.34737777941663 -0.003538331 -0.07119289828209606 49 0.0 2958.31298828125 7.618824005126953 -2.204719853710383 41 1815.1422455259 1927.7187397246316 0.3641052057907287 -0.015104215 -0.09054165726449644 49 0.0 2918.227294921875 7.068892955780029 -2.1233785129783853 42 1725.5254313968267 1940.4986482089598 0.3467229711784983 -0.0889725 -0.07974289532340606 49 0.0 2894.807373046875 7.314378261566162 -2.160443540081306 43 1816.71868352426 1958.2685210788181 0.35812154747894875 -0.039650977 0.018294182011850877 49 0.0 2930.80810546875 6.984562873840332 -2.110348077872283 44 2131.256119382638 2046.9027985414727 0.3570572341373427 0.0028908404 0.07074067934599518 49 0.0 2913.7392578125 6.655815124511719 -2.0580031256347473 45 1796.8197461861691 2047.695980566018 0.35766299723581285 0.013459087 -0.033230476180585354 49 0.0 2954.53369140625 7.1327056884765625 -2.1331357610514345 46 1772.1931388519229 2069.2158098485534 0.33319155292426506 -0.015678529 0.05102337972524558 49 0.0 2912.11376953125 7.307231903076172 -2.1593822259476063 47 1690.0122409718304 2072.990355407112 0.34566378916142243 0.065416984 -0.05713250285368155 49 0.0 2981.903564453125 7.50456428527832 -2.1883137054747044 48 1967.5268276285226 2105.0848989196506 0.3659979936563464 -0.09261977 -0.032425524099711125 49 0.0 2844.35693359375 6.771485328674316 -2.076709854613037 49 1434.2913702133308 2185.809843483644 0.36070350820637465 -0.013352248 -0.028218752285424607 49 0.0 2962.963134765625 7.216773509979248 -2.145857689214465 50 1094.7213179988578 2213.2642390214987 0.39252960861118674 0.12406348 0.009329398722860089 49 0.0 2764.572998046875 6.399585723876953 -2.0153796522809784
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data2, cmap='Greys', origin='lower', vmin=8,vmax=15)#, norm=norm)
apertures2.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
# set values for inner and outer annuli to collect background counts
inner_annulus2 = inner_annulus * pixel_ratio
outer_annulus2 = outer_annulus * pixel_ratio
# set up annulus for background
background_aper2 = CircularAnnulus(positions2, r_in=inner_annulus2, r_out=outer_annulus2)
# perform photometry on apertures for targets and background annuli
phot_table2 = aperture_photometry(im2.data, apertures2)
# perform background subtraction with outlier rejection
bkg_median = []
bkg_mask2 = background_aper2.to_mask(method='center')
bmask2 = bkg_mask2[0]
for mask in bkg_mask2:
aper_data = bmask2.multiply(data2)
aper_data = aper_data[mask.data > 0]
# perform sigma-clipped median
_, median_sigclip, _ = sigma_clipped_stats(aper_data)
bkg_median.append(median_sigclip)
bkg_median = np.array(bkg_median)
# do calculations on background regions found in annuli
# Get average background per pixel
phot_table2['annulus_median'] = bkg_median
# Get total background in the science aperture (per pixel * area in aperture)
phot_table2['aperture_bkg'] = bkg_median * apertures2.area
# subtract background in aperture from flux in aperture
phot_table2['aperture_sum_bkgsub'] = phot_table2['aperture_sum'] - phot_table2['aperture_bkg']
# put aperture sum in pixel scale
phot_table2['scaled_ap_sum_bkgsub'] = phot_table2['aperture_sum_bkgsub'] * pixarea2
phot_table2_sub = phot_table2['aperture_sum','annulus_median','aperture_bkg','aperture_sum_bkgsub','scaled_ap_sum_bkgsub']
phot_table2_sub.pprint_all()
aperture_sum annulus_median aperture_bkg aperture_sum_bkgsub scaled_ap_sum_bkgsub ------------------ ------------------ ------------------ ------------------- ---------------------- 154350.31122428898 14.731081008911133 4627.905587703133 149722.40563658584 1.0645398147381087e-08 154842.70059459383 14.747513771057129 4633.068092186739 150209.6325024071 1.0680040417205133e-08 152995.5274446654 14.63075304031372 4596.386626793612 148399.14081787178 1.055131282468179e-08 151925.1333700791 14.747247695922852 4632.984502218023 147292.14886786108 1.047260469810778e-08 154377.37545211014 14.636741638183594 4598.268000300942 149779.1074518092 1.0649429697610096e-08 152988.1566588257 14.582669258117676 4581.280661103221 148406.87599772247 1.0551862802949253e-08 153369.27559639796 14.521292686462402 4561.9986424417475 148807.2769539562 1.0580331672251594e-08 153480.5633974587 14.520864486694336 4561.864119517185 148918.69927794152 1.0588253900032313e-08 153790.86003753252 14.63075304031372 4596.386626793612 149194.4734107389 1.0607861689727481e-08 153793.5189675347 14.580427169799805 4580.576288284409 149212.9426792503 1.0609174871384954e-08 154558.51792570582 14.747779846191406 4633.151682155453 149925.36624355038 1.0659828829684016e-08 154391.4355799795 14.675836563110352 4610.550033195196 149780.8855467843 1.0649556121767344e-08 154730.98741690983 14.747779846191406 4633.151682155453 150097.8357347544 1.0672091566141773e-08 155506.61346753448 14.629916191101074 4596.12372285975 150910.48974467473 1.0729871999570461e-08 154378.6390810117 14.631589889526367 4596.649530727473 149781.98955028423 1.064963461741242e-08 155225.81717182428 14.508169174194336 4557.875769468682 150667.9414023556 1.071262659356061e-08 154765.34390772937 14.670455932617188 4608.859658272296 150156.48424945708 1.0676261528460426e-08 154207.8671537866 14.675836563110352 4610.550033195196 149597.31712059138 1.063650424101641e-08 153804.26662325312 14.592303276062012 4584.307277103069 149219.95934615005 1.0609673762733233e-08 153470.44153836626 14.744848251342773 4632.230694471476 148838.21084389478 1.0582531099740375e-08 153494.82526049044 14.52401065826416 4562.852518466254 148931.9727420242 1.058919765530631e-08 287890.68200928334 14.636741638183594 4598.268000300942 283292.4140089824 2.0142346273665622e-08 152851.27894667053 14.62843656539917 4595.658884736234 148255.62006193429 1.0541108369424264e-08 153929.97365571558 14.611905097961426 4590.465371070686 149339.5082846449 1.0618173800138879e-08 154953.76620085427 14.670455932617188 4608.859658272296 150344.90654258197 1.068965852353026e-08 153137.62304242808 14.544455528259277 4569.27546380428 148568.3475786238 1.0563343578060186e-08 152810.7716501354 14.626956939697266 4595.194046612717 148215.5776035227 1.0538261314497656e-08 153000.01207377977 14.743032932281494 4631.660395168793 148368.35167861098 1.054912368909682e-08 153836.28598838724 14.538564682006836 4567.424799873271 149268.86118851398 1.061315072785339e-08 154881.1510734548 14.747247695922852 4632.984502218023 150248.16657123677 1.0682780224271327e-08 152776.8770704783 14.572933197021484 4578.221987301751 148198.65508317656 1.0537058108030488e-08 153014.5515141123 14.757319450378418 4636.14863719866 148378.40287691363 1.0549838338366147e-08 153524.56192642747 14.662711143493652 4606.426561010886 148918.1353654166 1.0588213805342926e-08 152972.6261419549 14.63075304031372 4596.386626793612 148376.2395151613 1.054968452139338e-08 152912.27894477485 14.561355113983154 4574.584625240164 148337.6943195347 1.0546943923201886e-08 152755.79322914075 14.747513771057129 4633.068092186739 148122.72513695402 1.0531659420336343e-08 153431.49913811803 14.62843656539917 4595.658884736234 148835.8402533818 1.0582362548615725e-08 152651.43210578692 14.668549537658691 4608.26074663265 148043.17135915428 1.0526003074946981e-08 152827.7365185417 14.623654842376709 4594.156662144347 148233.57985639735 1.053954129092193e-08 152081.75933428964 14.71068000793457 4621.496424223748 147460.26291006588 1.0484557758211422e-08 155180.55433394693 14.587486267089844 4582.793969103145 150597.7603648438 1.0707636658463503e-08 153620.068310417 14.623654842376709 4594.156662144347 149025.91164827265 1.0595876796309237e-08 154843.8402184945 14.747247695922852 4632.984502218023 150210.85571627648 1.0680127388815052e-08 155703.47192189595 14.568169593811035 4576.725457216695 151126.74646467925 1.0745248047508688e-08 155189.41585449013 14.647760391235352 4601.729643664854 150587.68621082528 1.0706920377022063e-08 156452.21572862426 14.576680183410645 4579.39913779308 151872.81659083118 1.0798294306717426e-08 154651.4217523877 14.675836563110352 4610.550033195196 150040.87171919248 1.066804137323209e-08 156382.4971221863 14.742093086242676 4631.365133827688 151751.1319883586 1.078964242167578e-08 153535.0044982578 14.544455528259277 4569.27546380428 148965.7290344535 1.0591597758159063e-08 156381.8771165606 14.747247695922852 4632.984502218023 151748.89261434256 1.0789483200162472e-08
# using wcs info from images, put coordinates into RA, Dec
ra2, dec2 = im2.meta.wcs(sources2['xcentroid'], sources2['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra2)
dec_col = Column(name='Dec', data=dec2)
sources2.add_column(ra_col)
sources2.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources2['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources2_sub = sources2['xcentroid', 'ycentroid', 'RA', 'Dec']
sources2_sub.pprint_all()
# add option to print out list of sources with flux values
outtable = 'sourcelist_phot_rate.txt'
sources2.add_column(phot_table2['aperture_sum'])
sources2.add_column(phot_table2['aperture_sum_bkgsub'])
sources2.add_column(phot_table2['scaled_ap_sum_bkgsub'])
xcentroid ycentroid RA Dec ------------------ ------------------ ---------------------- ---------------------- 1391.6141252999453 245.0347408093039 0.0008759029399739719 -0.014629863807998586 1545.7572347543412 252.1019559115091 359.9985217945259 -0.014314073964044877 1947.5277150205711 302.60840183885466 359.992429041267 -0.012998972055832437 2082.6746723236847 311.9378235763498 359.99036926259834 -0.01267405571417998 1063.789366061669 365.36791486522367 0.006064667724031544 -0.013225819714069682 1592.116892800431 384.2801435010961 359.9979887838867 -0.012224880496800468 922.4767877401614 407.3003916342195 0.008287969921777839 -0.012772986756807587 1033.4790422750223 434.48916184739574 0.006622456417134419 -0.012206706849618169 1147.8735992775044 461.6758020522051 0.004904922745229274 -0.01163589476125468 1801.1754815096374 506.36616454715164 359.99494738018063 -0.01007150466532848 1275.8977202015315 524.0219496370104 0.0030257065718384837 -0.010507609005478383 1888.9736670250409 561.8540753047181 359.99367575667077 -0.009102512321893646 2062.7020619770788 563.1897196580086 359.99101361649883 -0.008848255083135836 934.5238670790632 590.5916391162401 0.008349885621938627 -0.00994620212003263 957.8663043621808 603.6154878016796 0.008009479970528114 -0.009715084851449968 1105.436365232163 625.2737905484375 0.005775796545586571 -0.009184401454629577 1588.7189797130275 645.7124120863735 359.99839268185633 -0.008220671065966726 1118.021489171493 654.9406193361164 0.005622738214091366 -0.008712557540503953 1873.1081683300906 683.053335092837 359.9940821279727 -0.007265401738262643 1610.5291139366375 712.2055396173664 359.99814772301517 -0.007171722002421739 888.4197174580918 758.8545092806571 0.0092832648813752 -0.007428112217032457 1457.9309137897321 810.1849041107366 0.0006194971498911289 -0.005874656919036006 1569.5317053282063 857.5056076567881 359.99897189615666 -0.004998870065593946 1245.76098431969 937.552373773233 0.0040442854537481 -0.004207119217542897 1041.985541281527 1074.872228360456 0.007353745732170821 -0.002375676410573401 1507.2976762781464 1123.6920818301298 0.00028437998133408666 -0.0010009323439317379 1586.083698151982 1144.0416184196597 359.9991036645209 -0.0005828762444534513 972.6632177664333 1149.031801792307 0.008516521165780453 -0.0013318024444091386 1517.3246123518506 1172.7606095131 0.0001966564752950504 -0.0002350267006437011 797.5450897726604 1250.8549988746404 0.011338786553503613 -6.100074250824046e-06 1889.2396788869835 1342.5814657915778 359.9947222584048 0.002869458053049115 1956.5852677506557 1361.2698888498435 359.9937147344135 0.003246648002692649 2117.779364809172 1392.7052968385651 359.99128529773316 0.003945585817067471 1715.5379910822505 1409.6123166210257 359.99747598604307 0.0036635633418285554 1806.178817220617 1477.5269226225776 359.99617749559195 0.004826930795338409 1094.5143440249483 1630.8864524711996 0.007296470098486586 0.006220887217614237 1504.5800979038495 1692.5731444071218 0.0010915622244294407 0.007718588381912742 2085.9213614890537 1696.8312045615687 359.992183050878 0.008566158985077059 1699.6587221957616 1712.450589623288 359.9981269898603 0.008285893788066158 1131.9528079734248 1813.9665719297636 0.006968752191805354 0.009078602209168663 1815.1422455259 1927.7187397246316 359.9966458487816 0.011742198205418369 1725.5254313968267 1940.4986482089598 359.9980372231628 0.011817572079123708 1816.71868352426 1958.2685210788181 359.9966627849202 0.01221276745644742 2131.256119382638 2046.9027985414727 359.9919589628501 0.013995133416651958 1796.8197461861691 2047.695980566018 359.99708825113936 0.013557264167958036 1772.1931388519229 2069.2158098485534 359.99749483161764 0.013854108904806142 1690.0122409718304 2072.990355407112 359.9987600662399 0.013801401347654457 1967.5268276285226 2105.0848989196506 359.99454786722777 0.014666972017130011 1434.2913702133308 2185.809843483644 0.0028330848269711045 0.015187257414872446 1094.7213179988578 2213.2642390214987 0.008076969246554152 0.015151300757748735
# Compare input RA, Dec to found RA, Dec
print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail')
deltara2 = []
deltadec2 = []
for i in np.arange(0,len(RA_sim)):
for j in np.arange(0,len(ra2)):
ra_diff = 180 - abs(abs(RA_sim[i] - ra2[j])-180)
dec_diff = 180 - abs(abs(Dec_sim[i] - dec2[j])-180)
if ra_diff < 1e-5 and dec_diff < 1e-5:
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
deltara2.append(ra_diff)
deltadec2.append(dec_diff)
if ra_diff < 30 and dec_diff < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {:15.6f} {:15.6f} {:15.6e} {}'.format(ra2[j], dec2[j], ra_diff, dec_diff,
phot_table2['scaled_ap_sum_bkgsub'][j], test))
RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail
359.998760 0.013801 21.361536 5.755148 1.066804e-08 pass
359.997495 0.013854 15.006176 6.807943 1.079829e-08 pass
0.000284 -0.001001 9.432067 17.756438 1.056334e-08 pass
0.006622 -0.012207 9.156898 2.544659 1.058825e-08 pass
359.998522 -0.014314 4.339707 11.066271 1.068004e-08 pass
359.998148 -0.007172 8.197145 1.000791 1.058253e-08 pass
0.007354 -0.002376 11.715364 20.435078 1.068966e-08 pass
359.997476 0.003664 14.450245 15.971969 1.054968e-08 pass
0.008517 -0.001332 8.923803 10.088800 1.054912e-08 pass
0.001092 0.007719 15.975992 8.681825 1.058236e-08 pass
359.996646 0.011742 11.344386 6.486460 1.070764e-08 pass
0.006969 0.009079 11.692110 1.432047 1.048456e-08 pass
359.994082 -0.007265 10.339298 1.446258 1.060967e-08 pass
0.004905 -0.011636 7.478117 3.221141 1.060786e-08 pass
0.008077 0.015151 3.489288 6.117272 1.078948e-08 pass
359.993676 -0.009103 8.075985 1.755641 1.064956e-08 pass
0.002833 0.015187 21.294623 0.926694 1.059160e-08 pass
359.998037 0.011818 9.996614 1.540515 1.059588e-08 pass
0.006065 -0.013226 11.996194 6.550971 1.064943e-08 pass
359.999104 -0.000583 12.007725 13.954480 1.053826e-08 pass
359.998972 -0.004999 11.173836 6.732236 1.054111e-08 pass
0.009283 -0.007428 17.046427 18.403981 1.058920e-08 pass
359.997088 0.013557 13.495898 6.248995 1.070692e-08 pass
359.991285 0.003946 16.928161 1.491059 1.058821e-08 pass
359.994947 -0.010072 5.831350 1.783205 1.060917e-08 pass
359.997989 -0.012225 4.378008 4.030212 1.055186e-08 pass
0.007296 0.006221 12.707645 14.806017 1.053166e-08 pass
359.992183 0.008566 17.816839 0.572346 1.052600e-08 pass
0.004044 -0.004207 9.772366 14.829183 1.061817e-08 pass
0.005776 -0.009184 11.532436 12.245237 1.071263e-08 pass
359.991959 0.013995 21.733740 0.480300 1.074525e-08 pass
359.990369 -0.012674 17.054646 0.200571 1.047260e-08 pass
359.994548 0.014667 22.077980 3.499262 1.078964e-08 pass
359.996177 0.004827 12.615869 18.249137 1.054694e-08 pass
359.998127 0.008286 14.436503 0.382363 1.053954e-08 pass
0.008288 -0.012773 10.908282 0.047675 1.058033e-08 pass
0.008009 -0.009715 12.672106 3.905465 1.064963e-08 pass
359.993715 0.003247 11.756111 8.467190 1.054984e-08 pass
0.000197 -0.000235 12.036689 10.896122 1.061315e-08 pass
359.994722 0.002869 9.869743 5.551009 1.053706e-08 pass
359.992429 -0.012999 10.651439 7.099401 1.055131e-08 pass
0.000876 -0.014630 7.549416 13.909709 1.064540e-08 pass
0.005623 -0.008713 11.742429 1.592854 1.063650e-08 pass
0.008350 -0.009946 11.211761 7.927632 1.072987e-08 pass
359.996663 0.012213 11.574287 0.837157 1.068013e-08 pass
0.003026 -0.010508 4.656341 1.407580 1.065983e-08 pass
359.991014 -0.008848 15.780604 0.918299 1.067209e-08 pass
359.998393 -0.008221 8.345317 9.615837 1.067626e-08 pass
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in millarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltadec2,deltara2)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
# Compare photometry between the original and scaled images
plt.title('Flux (MJy) vs. y position on detector')
#plt.ylim(33500,39000) # help weed out sources that were erroneously 'hits' (bad pixels, cosmic rays, etc)
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('y centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['ycentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='')
plt.plot(sources2['ycentroid']/2, phot_table2['scaled_ap_sum_bkgsub'], marker='+',linestyle='')
plt.show()
# Compare photometry between the original and scaled images
plt.title('Flux (MJy) vs. x position on detector')
#plt.ylim(33500,39000) # help weed out sources that were erroneously 'hits' (bad pixels, cosmic rays, etc)
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('x centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['xcentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='')
plt.plot(sources2['xcentroid']/2, phot_table2['scaled_ap_sum_bkgsub'], marker='+',linestyle='')
plt.show()
# Get some statistics of the two sets of fluxes for comparison
# get stddev from mean for each of the measurements in percentage
photdata1 = phot_table['scaled_ap_sum_bkgsub']
photdata2 = phot_table2['scaled_ap_sum_bkgsub']
std1 = np.std(photdata1)
mean1 = np.mean(photdata1)
std2 = np.std(photdata2)
mean2 = np.mean(photdata2)
per1 = std1 / mean1 * 100
per2 = std2 / mean2 * 100
print('Mean and standard deviation of original scale data', mean1, std1)
print('Mean and standard deviation of new scale data', mean2, std2)
print('The standard deviation from the mean (as a percentage) for the original scale flux data, is', per1)
print('The standard deviation from the mean (as a percentage) for the new scaled flux data, is', per2)
# Compare stats on overall image values, not just phot values
# im is the original scaled image and im2 is the rescaled image
# print stats on original input image
mean1, median1, std1 = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Original image mean, median and std',mean1, median1, std1)
# print stats on rescaled input image
mean2, median2, std2 = sigma_clipped_stats(data2, sigma=200.0, maxiters=5) # default sigma=3
print('Rescaled image mean, median and std',mean2, median2, std2)
ratio_mean = mean1 / mean2
#ratio_median = median1 / median2
print('The ratio of the mean of the two images is: ', ratio_mean)
#print('The ratio of the median of the two images is: ', ratio_median)
Mean and standard deviation of original scale data 1.0439144563964573e-08 1.1809115077171173e-09 Mean and standard deviation of new scale data 1.0811014527093917e-08 1.3352593459482903e-09 The standard deviation from the mean (as a percentage) for the original scale flux data, is 11.312339823260684 The standard deviation from the mean (as a percentage) for the new scaled flux data, is 12.350916212367888 Original image mean, median and std 10.161678 10.829916 46.34863 Rescaled image mean, median and std 10.193526 10.818869 48.573162 The ratio of the mean of the two images is: 0.99687564
If all RA/Dec matches have a 'pass' in the table for both original and scaled images, the fluxes for both the original data set and the scaled data set are roughly equal and the mean fluxes are nearly equivalent, then the notebook passes. The ratio printed of the means of the two images should be approximately 1.
Author: M. Cracraft, Senior Staff Scientist, INS/MIRI
Updated On: 04/02/2021 to add in testing the 'ratio' scaling option in resample.
